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Preface 


This book started with a simple idea to present in one volume the numerical and com¬ 
putational aspects of integration and quadrature rules, and to include most of the areas 
where numerical integration is required. This has taken us from quadrature rules for 
one-dimensional finite and infinite range integrals to their applications in differen¬ 
tial and integral equations, Fourier integrals and transforms, Hartley transform, fast 
Fourier and Hartley transforms, and wavelets. 

Since the publication of the book on methods of numerical integration by Davis 
and Rabinowitz (1984), there has been enormous productivity in theoretical as well 
as computational integration. Some attempts have been made to find an optimal or 
the best numerical method and related computer code to put to rest the problem of 
numerical integration. But the research is continuously ongoing as this problem is 
still very much open-ended. We have tried to include as much of this research as 
possible by consulting published research papers and books and citing them. 

Some information about the contents of the book is given below. More details 
can be found in the Table of Contents. 

Chapter 1 provides some useful definitions and results on orthogonal polynomi¬ 
als, divided differences, interpolation, convergence acceleration methods, and cu¬ 
bic splines. Chapter 2 deals with interpolator quadrature and presents Newton- 
Cotes rules, Rhomberg and Gregory integrations, iterative and adaptive schemes, 
and interpolatory product integration. The Gaussian quadrature and the following 
rules are discussed in detail in Chapter 3: Gauss-Jacobi, Gauss-Legendre, Gauss- 
Laguerre, Gauss-Hermite, Gauss-Radau, Gauss-Lobatto, Gauss-Chebyshev, Gauss- 
Log, Clenshaw-Curtis, Gauss-Kronrod, Patterson’s, Basu, and Bessel’s; Gaussian 
rules for moments and modified moments are discussed in detail; finite oscillatory 
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XIV 


PREFACE 


integrals and noninterpolatory product integration are studied. Chapter 4 deals with 
methods for improper integrals, slowly convergent integrals, infinite-range oscilla¬ 
tory integrals, and product integration. Quadrature rules for singular integrals are 
presented in Chapter 5; different types of singularities and acceleration techniques 
are discussed, and Cauchy’s p.v. and the Hadamard finite-part integrals are presented. 
Chapter 6 deals with Fourier integrals and transforms; interpolator rules for Fourier 
integrals, rational functions and trigonometric integrals are presented; discrete and 
fast Fourier transforms, and Hartley and fast Hartley transforms are discussed in 
detail. Chapter 7 provides a comprehensive account of methods of inversion of the 
Laplace transform. Chapter 8 deals with wavelets which are presented as an extension 
of Fourier transform. Although they do not involve numerical integration directly, 
they are presented to show the advantages they have over traditional Fourier methods 
in analyzing signals. Chapter 9 covers the areas of Fredholm integral equations of 
the first and second kind, and singular integral equations. 

There are three appendices: Appendix A contains thirty-two quadrature tables; 
some simple figures that are mentioned in Chapters 2, 7, 8 and 9 are collectively 
presented in Appendix B; and the contents of the CD-R which accompanies the book 
are described in Appendix C. 

The CD-R contains tables of over 5800 formulas for indefinite and definite inte¬ 
grals; quadrature tables in ASCII format so they need not be retyped by the users; pdf 
files listed in Appendix C; and computer codes in C++, f90, MATLAB, and Mathe- 
matica, all in ASCII format. This is followed by the bibliography which is large but 
by no means complete, and the subject index. 

The authors welcome comments and suggestions from readers. 

Prem K. Kythe Michael R. Schaferkotter 

pkythe @ uno.edu schaferk @ bellsouth.net 

September 2004 
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Notation 


A list of the notation, acronyms and abbreviations used in this book is given below. 


arg 

(^)ro 

Ax A 

A\B 

A 

(■ A f)( x ) 

A[a , b\ 
Ak 

Ai(m) 

A 

A T 

B (m,n) 
B x (p, q ) 

B(f) 

BR 

TD o(2/ 

JD 2k 

B q (x) 
C[a, b] 
C(x) 
C v [x) 

C k n 

Cn(x) 

Ci (x) 


argument of a complex number 

+ n) 

Pochhammer’s symbol = ————— =a(a + 1). .. (a+n —1) 

F(n) 

product of sets A and B 

complement of a set B with respect to a set A 

closure of a set A 

Lagrangian interpolant [see Po,i,... ,n( x ) ] 
class of admissible functions on [a, b] 
weights (see Wk) 

Lagrangian integration coefficients 
matrix 

transpose of a matrix A 

u ^ . r(m) r(n) 

betalunction = —-- 

T(m + n) 

incomplete beta function 

Bessel’s rule 

backward recursion 

Bernoulli numbers 

Bernoulli polynomial of degree q 

class of continuous functions on [a, b\ 

Fresnel cosine integral 
Young function 
Cotesian numbers 

ultraspherical (Gegenbauer) polynomials 
cosine integral 
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NOTATION 


xvi 


chi(x) 

CSK1 

CSK2 

C k [a,b\ 

CW(f) 

c 

det(A) 

D 

DCT 

DFT 

DHT 

DST 

Dp ( z ) 

D 

e-g. 

ET 

E n or E n (f) 
Eq(s) 
E(<p,k) 
E(fc), E(fc') 
E v (z) 

Ei(x) 


Ei(x) 

Em (%) 
erf(x) 
erfc(x) 

f _( x ) 

/o) 

/ 

/’W 

/ N, • • •, ar„] 

F(v,k) 

2 F 1 (a,f3,r,x) 

F(lo) 

F c (u>) 

F s {lo) 

FFT 

FHT 

FK1 


hyperbolic cosine function 
Cauchy singular equations of the first kind 
Cauchy singular equations of the second kind 
class of continuous functions with k continuous derivatives 
on an interval [a, b] 

Fourier (cosine) coefficients 
complex plane 
determinant of a matrix A 
domain 

discrete cosine transform 
discrete Fourier transform 
discrete Hartley transform 
discrete sine transform 
parabolic cylinder functions 
Daubechies basis 
basis 

for example 

Euler transformation 

error in a rule; also, Euler numbers 

equation(s) (when followed by an equation number) 

elliptic integral of the second kind 

complete elliptic integral of the second kind, k f = \/l — k 2 . 
Weber function 

exponential integral function defined by 



= p.v. Ei(x) 

exponential integral = f^° (e~ xt /t m ) dt 
error function 

complementary error function = 1 — erf (x) 
free term 

inverse Laplace transform 

approximation of / 

complex conjugate of a function f(z) 

divided difference of linear functions / (xq) , • • • , / (x n ) 

class of functions in C [a, b] or in R[a, b] 

elliptic integral of the first kind 

Gauss hypergeometric function, also F(a, /?, 7 ; x) 

Fourier transform of f{x) 

Fourier cosine transform of f(x) 

Fourier sine transform of f(x) 
fast Fourier transform 
fast Hartley transform 
Fredholm equation of the first kind 
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FK2 

Fredholm equation of the second kind 


FK3 

Fredholm equation of the third kind 


FLIT 

fast inverse Laplace transform 


FR 

forward recursion 


2 ^ 2 , 3^2 

hypergeometric functions 


n-^m ('? 

; x) generalized hypergeometric function 


F 1 , F 2 , F 3 , F 4 hypergeometric functions of two variables 


f 

vector 


Hf} 

Fourier transform of f(t) (same as F(uo)) 


T c 

Fourier cosine transform (same as F c (u)) 


T s 

Fourier sine transform (same as F s (u)) 


F*G 

type 1 convolution 


FoG 

type 2 convolution 


F^P) 

periodized function F with period P 


GnU) 

Gaussian rule 


GP 3 IR 

generalized piecewise polynomial product interpolatory rule 

GSJ 

/ 

generalized smooth Jacobi (weight function) 

\ 


G^(x 

ai,••• ,a p j Me jj er functions 


G V 

Catalan constant « 0.91596559 


h 

step size 


H{ x) 

Heaviside unit step function 


H(lo) 

Hartley transform 


h 2 [4>\ 

Hadamard transform of (j) 


H n (x) 

Hermite polynomials of degree n 


H a 

Holder condition for 0 < a < 1 


H 1 

Lipschitz condition 


H n (x) 

Hermite polynomial of degree n 


FLv (z), FLv (z) Hankel functions of the first and second kind 


H n (x) 

Hermite polynomials 


H v (z) 

Struve functions 


n\R) 

real Hardy space 


i.e. 

that is 


iff 

if and only if 


I 

integral 


Ff) 

= fa f( x ) dx 


I b aW) 

= fa W ( X )f( X ) dx 


Kf) 

quadrature rule 


I 

identity matrix, or operator 


In(z) 

modified Bessel functions of the first kind 



imaginary part 


IDFT 

inverse discrete Fourier transform 


HR 

interpolatory integration rule 


j„(*) 

Anger functions 
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Jn(x) 

JU) 

k(x,s ) 

k*(x,s) 

k^ (x, s) 

k\(x,s) 

k n (x,s) 

k v (x) 

k T 

K (k), K(fc') 
K n {z) 

K 

lj (x) 

Li 

L 2 

Lp 

L(x) 

L„(z) 

li(x) 

L n (x) 

(x) 

Li n (z) 

C 

c - 1 

LMM 

M n 

MnU) 

Mo, Mi,... 

M 0 {a,f3,z) 

M n ~ 

M\,fj,{z) 

nS 

N f 

N 

N-C 
O n (x) 
p.v., or pv 
Pi{x) 

{Pi(x)} 

PIIR 

PIR 

P(a, x ) 


Bessel function of order n and order zero 
quadrature rule related to Bessel’s rule 
kernel of an integral equation 
adjoint (conjugate) kernel 
degenerate (separable) kernel 
resolvent of the kernel k(x,s) 
n- th iterated kernel 
Bateman function 
transposed kernel 

complete elliptic integral of the first kind, k f = \/l — k 2 
modified Bessel functions of the second kind 
integral operator 

Lagrange interpolating polynomial 

function space 

function space 

function space, p> 1 

Lebesgue constant 

Lobachevskiy function 

modified Struve function 

logarithm integral = Ei (In x ), x > 1 

Laguerre polynomials 

generalized Laguerre polynomial 

Polylogarithm function of z of order n 

Laplace transform C{f{t)} = f(s) 

inverse Laplace transform 

linear multistep method 

modified moments 

repeated midpoint rule 

starting values of modified moments 

(or M(a,f3,z)) Kummer’s confluent hypergeometric function 

asymptotic expansion of M n as n —► oo 

Whittaker functions 

n significant digits 

number of function evaluations 

the set of natural numbers 

Newton-Cotes 

Neumann polynomials 

principal value 

polynomials of degree i = 0,l,2 ,... , n 
set of linearly independent basis functions 
positive interpolator (product) integration rule 
product integration rule 

1 f x 

incomplete gamma function = / e~ f t a ~ x dt 

r(a) Jo 
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Pn(x) 

Legendre polynomials of degree n 


shifted Legendre polynomial 

Pi a) (x) 

associated Legendre polynomials of the first kind 

P^’ P) (x) 

Jacobi polynomials of degree n 

Po,l,... ,n(x) 

Lagrangian interpolant 

V 

partition of an interval 

Vn 

class of polynomials of degree n 

QA Z ) 

Legendre functions of the second kind 

Qn(f), Qn 

quadrature rules n = 1, 2 ,... , N 

Q ( n\f) 

n- point Gaussian quadrature 

Qn a) (x) 

associated Legendre polynomials of the second kind 

R[a, b] 

class of Riemann-integrable functions on [a, b] 

RnU) 

Riemann sum 

R(f) 

remainder 

R(f) 

repeated rectangle rule 

RR 

recurrence relation 

R n 

Euclidean n-space 

R+ 

set of positive real numbers 

lZ(n, m) 

Patterson’s rule for I%(wf) 


real part 

s 

variable of the Laplace transform 

s j 

quadrature points 

snA z ), s u.A z ) 

Lommel functions 

Sn(x) 

Schlafli polynomials 

S(x) 

Fresnel sine integral 

s„(x) 

Schlafli polynomials 

shi(x) 

hyperbolic sine integral 

1, x > 0, 

sgn x 

sign function = 0, x = 0, 

— 1 , x < 0. 

Si(x) 

sine integral 

s 

sample, data 

S n 

Riemann sum 

S(f ) 

basic Simpson’s rule 

Sn(f) 

repeated Simpson’s rule 

Ski Sk 

Sidi’s rules 

5 W(/) 

Fourier (cosine) coefficients 

Si 

sine integral 

SKI 

singular equation of the first kind 

SK2 

singular equation of the second kind 

SFK1 

singular Fredholm equations of the first kind 

SFK2 

singular Fredholm equations of the second kind 

STFT 

short time Fourier transform 
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T(f) 

basic trapezoidal rule 


Tn(f) 

repeated trapezoidal rule 


TnU) 

repeated tangent rule 



T n ,k 

77 -th trapezoidal rule foe 2 k subintervals of 

[a, b\ 


m-panel trapezoidal rule on [0,1] 


T n (x) 

Chebyshev polynomials of the first kind of degree n 

T*(x) 

shifted Chebyshev polynomials of the first kind of degree n 

U(t - a) 

unit step function (= 

1 if t > a\ 1/2 if t = 

a; —1 if t < a) 

U(a,f3,z) 

Kummer’s confluent hypergeometric function 

U n (x) 

Chebyshev polynomials of the second kind of degree n 

U n (w, z) 

Lommel functions of two variables 


V n (w, z) 

Lommel functions of two variables 


v i 

weights in generalized quadrature rules 


v a b if) 

total variation of / over the interval [a, b] 


VkU) 

quadrature rule 



V n 

linear vector space 



W n if) 

repeated Weddle’s rule 


W{n) 

triangular window function 


WxAz) 

Whittaker functions 



w(x) 

weight function 



Wk 

Gaussian weights 



Wn,k 

weights 



W f (a, b) 

wavelet transform 



WFT 

windowed Fourier transform 


\x\ 

integral part of a real number x 


x = rn(k)n 

values of x from m to n step k 


Xi 

nodes (abscissae, or quadrature points); Nystrom points 

%n,k 

nodes 



T 

transpose of a matrix x 


X 

Banach space 



Y n (z) 

Neumann functions 



z* 

complex conjugate of z 



real part of a complex number z 


a 

frequency {uo = 27ra) 




r, (x +1\ , (xw 


(5{x) 

= / -- dt = - 

Jo 1 + t 2 

k 2 ny 

r>cr 


1 (a,x) 

incomplete gamma function = / e 1 t a 

1 dt 

r (a, x) 

J 0 

incomplete gamma function = T(a) — 7 (a 

/>no 

, x) 


= / e _t t a_1 

dt 


7e 

Euler constant « 0.5772156649* 



*This constant is usually denoted by 7; but we use y e to avoid confusion with other 
uses of the letter 7. 
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xxi 


r(*) 

Sij 

SMf 

m 

A 

A ( ”)/ 

Ax k 

X 

Xn 
X. {n) 

M 

v( X ) 
v(x, a) 

C(«) 

C(z),C(z,q) 

^(n) 

7T 

7r(x) 

n(x) 

n((/?, n, fc) 
cr(x) 

0 

0(7 

$(w) 

$(z,s,w) 

<f>(a, c; x) 

$1 (a, 7 7,^,2/) 
0(7 
0 

<1 

X[a,6] (7 

0(7 

<77 

uo 

u(f,6) 

0 

(u,v) 

V 2 

v (n) / 


gamma function 

Kronecker delta (= 0 if i 7 ^ j; = 1 if i = j) 

77 -th central difference 

Gregory correction term to repeated trapezoidal rule 

norm (maximum length) of a subinterval 

77 -th finite forward difference 

length of the interval [xk-i,Xk\ 

eigenvalue 

77 -th eigenvalue 

Christoffel weights 

characteristic value (= 1 /A) 

00 x l dt 

r(i + 1 ) 

r 00 x t+<* dt 

nu-alpha function = / —-- 

J o T(t + a + l) 

Weierstrss zeta function 
Riemann zeta function 
Chebyshev points; also, Gauss points 


nu function = 


L 


Christoffel nodes 

an approximate value of 7 r (= 3.14159) 
polynomial (x — x\) (x — X 2 ) • • • (x — x n ) 
Lobachevskiy angle of parallelism 
elliptic integral of the third kind 
Weierstrass sigma function 
unknown function in an integral equation 
scaling function of a wavelet; father wavelet 
Fourier transform of <j)(t) 

Lerch function 

confluent hyperbolic function = (a; 7; x) 

degenerate hypergeometric series in two variables 
Euler psi function 
approximate value of 0 

vector of approximate solutions 0’s; also, blocks 
characteristic function on [a, b] 

(mother) wavelet 

Fourier transform of a wavelet 0(t) 
radian frequency (u = 27ra) 
modulus of continuity of / 
empty set 


inner product of u and v on 

d 2 d 2 

Laplacian —- + - 7 —^ 
ox z oy z 

77 -th backward difference 


M (=/*/W9W *) 
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NOTATION 


/ 

// 

* 


nil 
cas 6 



Cauchy principal-value (p.v.) integral 

Hadamard (finite-part) integral 

summation with the first term halved 
summation with the first and last terms halved 
summation with the last term halved if n is odd 
norm 

double factorial defined in §1.3.4 
=cos 6 + sin 6 
column vector 

777 /! 

binomial coefficients = ——- : —— 

nl (m — n)\ 

end of a proof or an example 
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Preliminaries 


In this chapter we discuss some basic concepts and present results needed to study the 
numerical and computational aspects of integration. Proofs of most of the results can 
be found in standard textbooks on numerical analysis, and real and complex analysis. 
The notation used in this book, although standard, is presented prior to this chapter. 


1.1. Notation and Definitions 

Let R n denote the Euclidean n- space and 7?, + the set of nonnegative real numbers. 
The complement of a set B with respect to a set A is denoted by A\B, the product 
of the sets A and B by A x B, and the closure of a set A by A. 

A real- or complex-valued function / is said to belong to the class C k (D) if it 
is continuous together with its k- th derivatives, in a domain D, 0 < k < oo. In this 
case we shall often write that / is a C k (D )-function or that / is a C k -function on D , 
and a (7°-function is written as a C-function. The functions / in the class C k (D ), 
for which all k- th derivatives admit continuous continuations in the closure D, form 
the class of functions C k (D). The class C°°(D ) consists of functions / that are 
infinitely differentiable on D\ i.e., continuous partial derivatives of all orders exist. 
These classes are linear sets. Thus, every linear combination \ f + fig, where A and 
fi are arbitrary complex numbers, also belongs to the respective class. 

In the case of a real function / of a single variable, which is integrable in the 
Riemann sense, suppose that y = f(x) is a bounded function on the finite interval 
[a, b\. Partition this interval into n subintervals by the points a = < x\ < ... < 

x n = b. Let £ be any point in the i-th subinterval: Xi-\ < & < Xi. Then form the 


l 
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sum 

n 

S n = '^2f(ti)(x i -Xi- 1 ). ( 1 . 1 . 1 ) 

2=1 

Such a sum is called a Riemann sum. Let A = max (Xi — a^_i) denote the max- 

2 

imum length (or norm) of the subintervals, and consider a sequence of sums of type 
(1.1.1), Si, S 2 ,..., whose respective norms A 1 , A 2 ,... are such that lim A m = 0. 

ra^oo 

If, for any sequence of this type and any choice of the sequence {S m } has a com¬ 
mon limit S, then f(x) is said to have the Riemann integral S over the interval 
[a, b ]; i.e., S = J^ f(x) dx. A bounded function f(x) is Riemann-integrable iff f(x) 
is continuous almost everywhere. In particular, if f(x) G C [a, b], it has a Riemann 
integral. Also, if f(x) is bounded on [a, b] and continuous except for finitely many 
points of discontinuity, it is Riemann-integrable. 

The Schwarz, Holder, and Minkowski inequalities are, respectively: 


J f(x)g(x)dx < /j \f(x)\ 2 dx^ 1 (J \g(x)\ 2 dxj ' , ( 1 . 1 . 2 ) 


[ f{x)g{x) 
J a 


dx 


< 


j \f(x)\ 2 dx^j /P (y \g(x)\ 2 dx^j /q , p > 1 , 

(1.1.3) 


( f | f(x) + g(x)\ P dxj /p < ( J \f(x)\ p dx^ /P (y \g(x)\ P dx^ /P , p> 1, 

(1.1.4) 

where 1/p + 1/q = 1. 

Let T : X \—> X be a linear operator on the normed space X of dimension n. Let 
e = {ei,... , e n } be any basis for X and let T e = (a^-) be the matrix representing 
T with respect to that basis whose elements are kept in the given order. Then the 
eigenvalues of the matrix T e are called eigenvalues of the operator T e , and the 
spectrum and the resolvent set are similarly defined. A basis result is as follows: All 
matrices representing a given linear operator T : X \ —> X on a finite-dimensional 
normed space relative to various bases for X have the same eigenvalues. Other results 
are: (i) a linear operator on a finite-dimensional complex normed space I / {0} 
has at least one eigenvalue; (ii) the eigenvalues of a Hermitian (self-adjoint) matrix 
A are real, whereas those of a skew-Hermitian matrix are purely imaginary or zero, 
and those of a unitary matrix have absolute value 1. 


The theory of numerical integration uses many results from the theory of orthog¬ 
onal polynomials, theory of interpolation and of finite and divided differences. It is, 
therefore, necessary that we introduce these topics before we discuss quadrature rules 
and their convergence. We will say that / E V n if / is a polynomial of degree n. 
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Two useful formulas are as follows: 

(i) The Leibniz rule for differentiating an integral with respect to a parameter is 

d f b f b 

J 9 (t,y)dt = J g v (t,y)dt, 

Q fh 2 (y) rh 2 (y ) Q ^ 5 ) 

— / g(t,y)dt = / g y (t,y)dt + ti 2 (y)g(h 2 (y),y) ' ' ' 

d v Jh, 1 (y) J hi (y) 

K(y) g ( h i(y),y) ■ 


For details, see Williamson, Crowell, and Trotter (1962, p.316). 
(ii) The Poincare-Bertrand formula is 


1 f dC 1 fgic Cl) 

7r C - z 7r C - Ci 


dCi = 5(2.2) 


+ - / rfCi • - / 

*7T ITT J r 


9 (Ci Cl) 


or, alternatively, 

dC [ g(C,Ci) 


l A “ ’ r29( " > S> + /r * '/r 


r(C-s) (C - Ci) 
g (C. Ci) 


(C-2:)(C-Ci) 


dC, (1.1.6) 


dC, (1.1.7) 


where the function ^ (C, Ci) satisfies the Holder condition with respect to both vari¬ 
ables. This formula is useful when changing the order of integration in singular 
integrals. 


1.2. Orthogonal Polynomials 


Besides the interpolating polynomials, many orthogonal polynomials are important 
for quadrature methods. The zeros of these polynomials are usually real, distinct, 
and contained in a particular interval. As such, these systems of zeros are used as 
nodes of quadrature rules, which possess additional properties, like that of positivity 
or minimality of the quadrature error. Table 1.2.1 gives the classical polynomials 
corresponding to their specific weights and intervals. 

A set of of polynomials with degree i and such that ( Pi,Pj ) = 0 for i ^ j 
is called a set of orthogonal polynomials with respect to the inner product , pj ) on 
a finite or infinite interval [a, b\. Let w(x) be an admissible weight function on the 
interval [a, b\. If we orthonormalize the powers 1, x, x 2 ,..., we obtain a unique set 
of polynomials p n (x) of degree n and leading coefficient positive, such that 


f 


w(x) Pn(x ) p m (x) dx = 8 „ 


f 0 if m ^ n, 
\ 1 if m = n. 


( 1 . 2 . 1 ) 
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where 6 mn is known as the Kronecker delta. 


Table 1.2.1 


Name 

Symbol 

Interval 

w(x) 

Chebyshev*, 1st kind 

T n (x) 

[-1.1] 

il-x 2 )- 1 / 2 

Chebyshev, 2nd kind 

U n (x) 

[-i.i] 

(1 — x 2 ) 1 ! 2 

Ultraspherical (Gegenbauer) 

C%(x) 

[-i.i] 

(1 -x 2 )^- 1 / 2 , p > -1/2 

Hermite 

Hnix) 

( — 00, 00) 

e x 

Jacobi 

Pi a ’ P \x) 

[- 1 . 1 ] 

(1 — x) a (l + x)P, a,(3 > 1 

Laguerre 

Unix) 

[0, oo) 

e~ x 

Generalized Laguerre 

L^ix) 

[0, oo) 

x a e ~ x , a > 1 

Legendre 

Pnix) 

[-i.i] 

1 


* Also spelled ‘TschebyschefE. 


Orthogonal polynomials with respect to the above inner product satisfy another 
type of orthogonality, known as “discrete” orthogonality. Let V n denote the class of 
all polynomials Pi(x), i = 1,... , n + 1, such that 

Pn(xi) = ai, i = 1,... , n + 1, (1-2.2) 

where x\ < X 2 < ■ ■ ■ < are (n +1) distinct points and a \,... , arbitrary 
numbers. 

Letpo (%), Pi (x ),... , p n ( x ), p n+ 1 ( x) be orthonormal polynomials with the weight 
function w(x) on [a, b\. Let x\ ... , x n+ i be (n + 1) zeros of p n+ i(x) and let 
wi,... , w n +i be the respective Gaussian weights. Then 

nb n+l 

/ w{x)f(x) dx = ^ Wi f (xi) (1.2.3) 


for all / G T^n+i- Now, since Pj(x)pk(x) G P2n+i for j, k < n, we have 


n+l 

i=l 


+) = / w(x)pj(x)pk(x)dx = 6j k . 

J a 


(1.2.4) 


Thus, pep Pi 7 • • • , Pn are orthonormal on the zeros of p n +i with respect to the inner 
product (1.2.1). Also, if po(#)? Pi (#)?•• • are orthonormal polynomials with p n (x) = 
c n x n + • • •, c n >0, with respect to this inner product, then we have the recurrence 
relation 


Pn+\{x) = {^ n x - a mn ) Pn(x) - a„,„-ip n -i(r)- a n0 p 0 (x), (1.2.5) 
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for n = 0 , 1 ,, where 


Po(x) = Co, 


7 n — 


Cn+1 

? 

Cn 


_ 7 n(xp n ,Pk) 

ttnk — / \ ? 

\Pk,Pk) 


k = 0 , 1 ,... , n. 


Moreover, if the above inner product satisfies the further condition (xpi,Pj) = 
(pi,xpj), then the recurrence relation (1.2.5) reduces to the three-term recurrence 
relation 


Pn+l(x) = (7 n X - a n )p n (x) - (3 n p n - 1 (x), n = 0,1,... , (1.2.6) 

where we take p_i (x) = 0 , and 


Pn 


\Pn ? Pn ) 

ln{xPn,Pn-l) _ 7n (Pn,Pn) 
(jPn— liPn— l) 7n—1 (jPn— liPn— 1 


The three-term recurrence relation for p n (x) yields a “backward” recurrence for an 

N 

efficient computation of a series expansion of the form f(pc)= c k p k (x). If we 

k =0 

set 


( 0 for k > n, , 

Bk = { , \ (1-2.7) 

l C k + (jk+ix - <Xk+i) B k+ 1 - (3 k + 2 B k + 2 for 0 < k < n, 

then 

f(x)= l0 B 0 . (1.2.8) 

Finally, orthogonal polynomials satisfy the Christoffel-Darboux identity 


n 


E 


Pk(x)p k (y) 

h k 


Pn+l(x)Pn(y) ~ Pn{x)Pn+l{y) 
l n h n {x - y) 


(1.2.9) 


where h k = (p&, p& ). The zeros of some orthogonal polynomials are used in quadra¬ 
ture rules. We consider some of the most frequently used polynomials. Information 
on others is available in Abramowitz and Stegun (1968). 

1.2.1. Chebyshev Polynomials of the First KindT n (x) = cos(n arccosx 
n = 0,1,..., over the interval [—1,1], such that T n (l) = 1. The m-th zero x n?m of 
T n (x) is given by 

(2 m — l)7r 
X n ,m = COS---. 
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It satisfies the orthogonality condition 


f 1 1 

J Vl a ; 2 Tn ^ Tm ^ dx 


= < 


0 if n ^ m, 

7r/2 if n = m ^ 0, 
7 r if n = m = 0 . 


The three-term recurrence relation is T n+ i (x) = 2x T n (x) — T n _ i (x). Other relevant 
data are as follows: 


Norm 


: J (l-x 2 ) 1/2 [T n (x)] 2 dx 


Jr n ^ 0 ’ 

[ 7r, n = 0; 


In/ 2 ] 


Series form: T n (x) = — ^ (~ 1 ) fc 07 ^ (^ X ) n ~ 2k = cos(narccos x); 


k =0 


kl(n-2k)l 


Indefinite and definite integrals: / Tq dx = Ti 1 j Ti dx = , 


i 


T dx = ^\ T n+l( x ) T n-l( x ) 


“/ r„dx = r„ 

■ /: 


2 L n + 1 n — 1 
Inequality: |T n (x)| <1, —1 < x < 1; 

(—l) n (l — a ; 2 ) 1/2 y/n d 


T r> dx = < 1 — n 2 


0 , 


, n even, 
n odd; 


Rodrigues’ formula: T n (x) = 




2 w + 1 T(n + l/ 2 ) dx 71 

A useful formula which is a special case of the Christoffel-Darboux formula (see 
Davis 1976) is 

n t 

5 [T„+i(*) T n (y) - T n+1 (y) T n {x )] = (* - y) £ T fc (®) T fe (t/). (1.2.10) 

k =0 


Table 1.2.2. Coefficient Triangle. 



x° 

x 1 

x 2 

x 3 

x 4 

x 5 

x 6 

x 7 

O 

Is 

05 

00 

3o(*) 

1 









X{x) 


1 








T 2 (x) 

-1 


2 







T 3 (x) 


-3 


4 






T 4 (x) 

1 


-8 


8 





T 5 (x) 


5 


-20 


16 




T 6 (x) 

-1 


18 


-48 


32 



T 7 (x) 


-7 


56 


-112 


64 


T 8 {x) 

1 


-32 


160 


-256 


128 

Tg(x) 


9 


-120 


432 


-576 

256 

Tw(x) 

-1 


50 


-400 


1120 


-1280 512 
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The coefficients D n;m of x m in T n (x) are calculated by the recurrence relation 

Dn,m = 2-Dn—l,m— 1 ^ 2, Tfl <C 77, (1.2.11) 


which yields the ‘coefficient triangle’ presented in Table 1.2.2, e.g., for T n (x), n = 
0 , 1 ,... ,10 (the blank represents zero). 

1.2.2. Chebyshev Polynomials of the Second Kind U n {x) over the 
interval [—1,1], such that U n ( 1) = n + 1. The m-th zero x n?m of U n (x) is given by 

rriTT 

%n,m = COS ■ — • 

n + 1 

It satisfies the orthogonality condition 



U n (x)U m (x) dx 


0 if n ^ m, 

< 7r/2 if n = m ^ 0, 
7 r if n = m = 0 . 


The three-term recurrence relation is U n +\{x) = 2x U n (x) — U n -\(x). Other rele¬ 
vant data include: 

Norm: J (l - x 2 ) 1/2 [U n (x)] 2 dx = L 


[n/2] 

Series form: U n (x) = (—1) 

k =o 

sin(n + 1)6 


k ( n k)\ [2x) n ~ 2k — 


fc!(n — 2k)\ 


n + 1 


U n (cos6) = 


16 




^ . , . TT 1 n = 2m, 

Definite integral: j U n dx = < n + 1 

I 0, n = 2m + 1; 
Inequality: | U n (x) | < n + 1, — 1 < x < 1; 

Rodrigues’ formula :U n (x)= ^ 1) (n + 1) 


(1 - x 2 ) 1/2 2 n+1 T(n + 3/2) dx' 


; {(l-x 2 r +1/2 }. 


1.2.3. Gegenbauer (or Ultraspherical) Polynomials C%(x) over the 

n + 2/jl — 1\ 

. Other relevant data are: 


interval [— 1 , 1 ] such that C%( 1 ) = 

: f 1 (1 - x 2 )^ 1 ' 2 [CZ(x)} 2 dx = 

1-1 ’ n\(n + u)\T(u)] 2 


Norm 


[n/2] 


Series form: C£(x) = ^ (_ 1 )fc F (^+ ( 2 x )™- 2 fc. 


fe =0 


fc!(n — 2k)\ 
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wn+2 M -1\ if M > 0, 

Inequality: max \C%(x)\ = < 71 

-i<*<i 1 1 l |C£(a: , )|, if —1/2 < ft < 0, 

where x' = 0 if n = 2k; x' = maximum point nearest zero if n = 2k + 1; 

(—l)"2"n! r(/i + n + 1/2) 


Rodrigues’ formula: C%(x) = 


r(n + 1/2) r(n + 2/x) (1 - x 2 f~ 1/2 

£{<1 


dx n 

1.2.4. Hermite Polynomials Hi a) ( x ) over the interval (—00,00), such 

that 

/ oo 

e~ x<1 [ff(“)(*)] dx = 0/2 n n!; 

-OO 

Inequality: |i^2n(^)| < e x 7/2 2 2n nl 

|-^2n+l | ^ 


2 - 


1 (2n 

2^ 


n 


\x\ e 


,2 ^2 (2n H - 2)! 
(n + 1)! 5 


Rodrigues’ formula: H n {pc) = (—l) n e a 


d n 

dx n 


<(ol,/3) 1 
n \ 

. Other relevant data are: 


1.2.5. Jacobi Polynomials Pn ^ (x) over the interval [—1,1], such that 

n + cO 


The three-term recurrence relation is H n+ 1 (x) = 2x H n (x) — 2 n H n _ 1 (x). 

1.2.5. Ja 

/ 1 

(1 — x) a (l + x)^ [P^ a, ^(x)] 2 dx 

_ 2°^ +1 T(n + a + l)T(n + f3 + 1) _ 

(2n + a + /?)n!T(n + a + (3 + 1) 


Norm 


[n/2] 


1 L ' J 

Series form: P/ a,/3 )(x) = — ^ 


n + cA / n + (3 


2 n f-^V k J \n-k 

k=0 


(a: — l) TO “ #B (a:+ 1)^; 


Inequality: max P/ a,/3 Vx) = n , ^ 

H —1<X<1 n v ' I |p(«^) 


( n ^) ~ nQ if Q. = max(a, /?) > —1/2, 
|Pn a,/3 )(^ , )| ~ n _1//2 if ^ < —1/2, 
where 2/ is one of the two maximum points nearest (/? — a)/(a + (3 + 1); 

(-l) n 


Rodrigues’ formula: P^^\x) = 


2 n n!(l — x) a (l + x)^ 3 
d n 

x }■ 
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1.2.6. Laguerre Polynomials L n (x ) over the interval [0, oo), such that 
L n (0) = n! and 


~ x L n (x)L m (x) dx = 


0 if n 7 ^ m, 
(n !) 2 if n = m. 


Its m-th zero x n?m is given by 


_ 3 m (i | ^ 

^r?,.rr?, — . . I -L I , _ , o 


0 (n" 5 ), 


where k n = n+1/2 and is the m-th positive zero of the Bessel function J n (x) . The 
three-term recurrence relation is (n+l)L n+ i(x) = [(2n+l)—x\ L n (x)—nL n -i(x). 
Other relevant data are 


Norm: / e x [L n (x)] dx = 1; 

Jo 

Series form: L n {x) = ^(-l) fc ( " k A 

k =0 V ' 

f e^/ 2 , if x > 0 , 

Inequality: |L„(x)| = | _ 1 1 , /2 jf 

^ L n!J 

1 d n 

Rodrigues’ formula: L n (x) = -{x n e~ x }. 

Tl. (3 CLX 


1.2.7. Generalized Laguerre Polynomials L%(x) over the interval 
[ 0 , oo), such that its m-th zero x n?m is given by 


_ fa,p ( 2(a 2 -l) 

n ’ m ~ Ak n V + 48^2 


O (n" 5 ) 


where k n = n-\-(a + l)/2, a > —1, and is the m-th positive zero of the Bessel 
function J n (x) . Other relevant data are 

Norm: f°° x a e~ x [L%(x )\ 2 dx = ^ + “ + ^ ; 


Series form: L“(*) = 5>i)* (" + “) 

k =0 ' ' 


Inequality: L%(x) 


r(n + H + l) W9 

— / e x / 2 , lf x > 0, a > 0, 

n\T{a + 1 ) 

r_r(n + a + l)i ^ ifa; > 0 , -1 < Q < 0 ; 
L n!r(n + 1) J 
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1 d n 

Rodrigues’ formula: L%(x) = —;-=— {x n+ot e~ x \. 

nW n\x a e~ x dx n 1 J 

1.2.8. Legendre Polynomials P n (x) over the interval [—1,1], such that 
P n (l) = 1 . If x n?m denotes the m-th zero of P n (x), where x n ,\ > x n ^ > • • • > 
x n ,n, then 

/. 1 1 \ (4m - l)7r _ ✓ _a\ 

Xn ’ m - l 1 - 8^ + 8^0 C ° S 4n + 2 + ° (n 1 

The three-term recurrence relation is (n+l)P n+ i(x) = (2n+l) x L n (x)— nL n -\{x). 
Other relevant data are: 

/ 1 2 2 

[■ P n (x )] dx = 2n + 1 ', 

, [n/2] 

Series form: P n (x) = — ^ (-l) fe 

k =0 

Indefinite Integral: J P„(x) dx = [ P n+ \(x) - P n - i(x)]; 

Inequality: | P n (x) | < 1 , — 1 < x < 1; 

(—l) n d n 

Rodrigues’ formula: P n (x) = — {fl - x 2 )' 1 }. 

2 n n\ dx n L J 

The orthonormal Legendre polynomials p n (x) are defined by 

Pn (x) = y/ 2n + 1 p w ( a ,) ) 
with the leading coefficient of p n (x) is 


2 n — 2k 


„n—2k. 


CL n 


2n + 1 ( 2 n)! 

2 2 n (n !) 2 ’ 


There are some other polynomials that arise in quadrature and have weights 

w(x) = lnx on [0,1], w(x) = sinx on [0, i r], and w(x) = cosx on [— 7 t/ 2 , 7 t/ 2 ]. 


1.2.9. Shifted Legendre Polynomials. These polynomials, denoted by 
P* (x), are defined on the interval 0 < x < 1 . They are obtained from the Legendre 
polynomials P n (x), which are defined in [— 1 , 1 ], by substituting 2x — 1 for x in 
P n (x). They are defined by 

= <-D” B-i)‘ (l) >2 ^r ( 3 ' L12 > 

k =0 ' ' 
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A few shifted Legendre polynomials are 

P 0 *(z) = 1, 

Pj*( x) = 2x-l, 

P 2 (x) = 6x 2 — 6x + 1, 

P 3 * (x) = 20x 3 - 30x 2 + 12a - 1, 

P 4 (x) = 70x 4 — 140x 3 + 90x 2 — 20x + 1, 

P 5 *(x) = 252x 5 - 630x 4 + 560x 3 - 210x 2 + 30x - 1. 


The shifted Legendre polynomials P* (x) have the additional advantage that its co¬ 
efficients are all integers, and they satisfy the normality condition 



1 

2n 1 


Since the polynomials P* (x) are orthogonal, any well-behaved function f(x) can be 
expanded into a series of the shifted Legendre polynomials. Thus, 


f( x ) = 'P A nPn( x )> 

n =0 

where A n = (2 n + 1) f* f(x)P*(x) dx. 

Example 1.2.1. Zeros of the Legendre polynomial of degree 9 are 
X! = -0.96816, x 2 = -0.836031, x 3 = -0.613372, x 4 = -0.324253, 
x 5 = 0, x 6 = 0.324253, x 7 = 0.613372, x 8 = 0.836031, x 9 = 0.96816. 

Zeros of the shifted Legendre polynomial of degree 9 are 
2/i = 0.01592, y 2 = 0.081984, y 3 = 0.193314, y 4 = 0.337874, y b = 0.5, 

2/e = 0.662127, 2/7 = 0.806686, y 8 = 0.918016, y 9 = 0.98408. 

Some of the weights Wj corresponding to the shifted Legendre polynomials 
are w[ = w' Q = 0.040637, w 2 = w' 8 = 0.090325, w' 3 = w' 7 = 0.13030, 
w' 4 = w' 6 = 0.15617, w' 6 = 0.16512. - 

1.2.10. Shifted Chebyshev Polynomials. The shifted Chebyshev poly¬ 
nomials, denoted by T* (x) and U* (x), respectively, are defined in the same manner 
as the shifted Legendre polynomials, by replacing x in T n (pc) or U n (x) by 2x — 1. 
Some of the shifted Chebyshev polynomials are 


T*(z) = 1 , 

Tf(x) = 2x-l, 

T 2 (x) = 8x 2 — 8x + 1, 

T 3 (x) = 32x 3 — 48x 2 + 18x — 1, 


US(x) = 1, 

UZ(x) =4x-2, 

U 2 (x) = 16x 2 — 16x + 3, 

U 3 (x) = 64x 3 — 96x 2 + 40x — 4. 
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In general, 


K(x) 


K(x) 


(-!>" D- 1 )' (t) * n{n + ‘a-1)^ * +11 din*) 

(_l)w 2 w (2n + 1)!! y^/_ 1 xfe AA ofe (n + 2)... (n + fc + 1) 

(n ± 2)(n ± 3)... (2n ± 1) ^ j \k) (2k - 1)!! (1 2 m j 


or, in terms of the trigonometric notation, 


T*(x) = cos (n arccos(2x — 1)), 

sin ((n ± 1) arccos(2x — 1)) 


K(x) = 


2^/x (1 — x) 


(1.2.14a) 

(1.2.14b) 


The double factorial used in the above formulas is defined as follows (Abramowitz 
and Stegun 1968, p. 258): 


(2 n)\\ = 2 • 4 • 6 • • • (2n) = 2 n n \, 

(2 n - 1)!! = 1 • 3 • 5 • • • (2n - 1) = 7r“ 1/2 2 n T(n ± \). 


1.2.11. Shifted Jacobi Polynomials. The Jacobi polynomials (x) 

reduce to the Legendre polynomials P n (x) for a = (3 = 0, and to the Chebyshev 
polynomials T n (x) and U n (x) fora = (3 = ±1/2, respectively. Generally, for a = (3 
the Jacobi polynomials are known as ultraspherical or Gegenbauer polynomials. 
The Jacobi polynomials satisfy the recurrence relations 

A+f±) 

_ 7 [a 2 - (3 2 + ('~f 2 -l)x\pi a ’ l3 \x)-2(n + a)(n + P)(j + 1 )-P±f±) 
2 (n+l)( 7 -n)( 7 -l) n 9 ± 


with 7 = 2n + a + /3 — 1, and the initial values are P^ s ' i:S) (x) = 1, P\ “' p 1 ( x) = 

( x +1) + —(x — 1). These three-term recurrence relations are very useful 
in computation. 

The shifted Jacobi polynomials Pn ^ a ^\x) are defined on the interval [—1,1]. 
They are related to the Jacobi polynomials, which are defined on the interval [0,1], 
by Pn (x) = Pn a (2x — 1), and defined by 

P*(«^)(aO = \- x )-P^L [x a+n (l - xf +n ], (1.2.16) 

ti> ax 




which is sometimes called Rodrigues’ formula for Pn (a ' 0 \x). 
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The Jacobi polynomials and the Chebyshev polynomials are related by 


P i 1/2 ’ 1/2) (x) = b n T n (x ), where b n = 22n -i T ( n + 1 y 

A 1/2,1/2) (© = £/»(*), where c n = 

2 n ' (n+1 ' ) - (1.2.17b) 

p . (-1/2,-1/2) (a;) = 6nT *( a .) j (1.2.18a) 

p* (1/2,1/2) (a;) = (1.2.18b) 


Finally, for any polynomial p(x) G V n , which has the leading coefficient equal to 
unity, i.e., p(x) = x n + a n _i x n_1 + • • • + ao, the following result holds (Krylov 
and Skoblya 1977): 

J \p(x)\ dx > 2 _n+1 , 

where the equality is true only for p(pc) =2 ~ n U n (x). 


1.3. Finite and Divided Differences 


We will discuss the finite and divided differences, which will be useful in deriving 
quadrature formulas. 

1.3.1. Finite Differences. Suppose that the values of a function f(x) are 
known at the equally-spaced points Xk = xo + kh, k = 0,1,2 ,..., and let us use 
the notation: f 0 = f (x 0 ), fi = f (^i), • • •, fk = f (x k ). Then the quantities 

A/o = fl- /o, A/i = / 2 - /l, • • • , A fn = fn +1 - /nr" , 
are called the forward finite differences of the first order ; the quantities 
A 2 / 0 = A/, - A/o, A 2 /! = A/ 2 - A/j,... , A 2 f n = Af n+1 - A 
are called the forward finite differences of the second order , and so on. Also, 
A 2 / 0 = A (A/o) = A/ 2 - A/i =f 3 - 2/ 2 + h, 

A 2 fi = fi +2 — 2/j+i + /i-i, 

A 3 /i = A (A 2 / x ) =U- 3/s + 3/ 2 - /i, 

A 3 /^ = fi +3 — 3/ i+2 + 3/j+i — /,, 
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and, in general, 

A Vi = /*+»-(") fi+n- 1+ Q fi+n-2-■ • (-I)”” 1 ( n " / l+ l + (-l)”/, 

(1.3.1) 

This provides the recursive relation 

A™/ = fn — fn—1 + ^2^ /™-2 — f n ~ 3 + ‘ ‘ ‘ + ( — 1) n fo- (1-3.2) 

If we introduce the operator H which increases the argument by h, i.e., TLf(x) 
= f(x + h), or Hfk = fk+ 1> then the relation (1.3.2) can be written symbolically as 

A n /o = (W-l) n /o. (I.3.3) 

Note that any value of the function f n can also be expressed in terms of /o and the 
forward finite differences A/ 0 , A 2 / 0 ,..., by using the relation 

fn = fo + A/ 0 + A 2 / 0 + • • • + A n / 0 , (1.3.4) 

or symbolically by 

/ n = (l + A)"/o. (1.3.5) 

Also, note that 

A ( ax n ) = a{x + /i) n — ax n = (an/i)x n_1 + terms of lower degree in x, 

A (an/ix n_1 ) = an(n — l)h 2 x n ~ 2 + terms of lower degree in x, 

Ap n (x) = A ( a 0 x n + aix n_1 H-b a n _ix + a n ) 

= a^nhx n ~ x + terms of lower degree in x, 


and thus, 


A n p n (x) = a n n\. 


The backward difference operator V is defined by 


V/i = /i - /i- 1 , 
V n+1 /z = V(V n / z ). 


(1.3.6) 


Note that the forward and backward difference formulas represent the same polyno¬ 
mial. Also, V/ n , V 2 / n , V 3 / n , ... denote the same numbers as A/ n _i, A/ n _2, 
A n _3, .... 
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The central differences are defined by 

<5/n+1/2 = <Wl/2 = ^n+1/2 = fn+1 ~ fm 
= ^n+1/2 — $n- 1/2 = fn+1 ~ 2fn + fn-1, 

$n+l/2 = $n +1 ~ = fn +2 ~ 3/ n +l + 3 f n - f n - 1, 

e = E(-D fe ( 2 ")/n +fe -„ 

j=0 v J 7 

2fe+l /qI I 1 \ 

Cv^Ei- 1 )! , )/»«+•->. 

j=0 \ J / 

^l/2n = ^1/2 (n-fc) ^ n and ^ h ave the same Parity. 


1.3.2. Divided Differences. In the case when the values of the argument are 
unequally spaced, the finite differences are replaced by quantities which are called 
divided differences. Let xo, x\, X2 ,... , x n , ... denote the arbitrary values of the 
argument. The divided differences of the first order are defined by 

Xi — X2 X2— Xi 

the divided differences of the second order by 

f[x 1 ,X 2 ] - f[x 0 ,x i] 


/ [x 0 ,Xi,X 2 ] = 
f [x 1 ,x 2 ,x 3 \ = 


X 2 -Xo 
f[x2,X 3 \ - f[x 1 ,X 2 \ 


x 3 - Xi 

the divided differences of the third order by 

„ ! _ f[xi,X 2 ,X 3 \ -/[ZO, £1,2:3] 

J I Xq , X 1, X21 X3 I , 

X 3 ~ X 0 

and so on. This leads to the formula 

f [x 3 , , X n \ — f [x, Xo, ■ ■ ■ , X n _i] 


f[ X,X 0 ,...,X n \ = 


Xn Xq 


(1.3.7) 


Note that, in general, the divided difference f[x o,xi,... , x n ] is a linear function of 
/ (^o) ,•••,/ (x n ), and 

f(x k ) 


f[x 0 ,xi,... ,x n \ E ^ Xk _ XQ j ... (x k -x k _{) (x k -x k+l )... (x k — x n )' 

(1.3.8) 
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This result, which can be proved by induction, is written in short by 



(1.3.9) 


where ir(x) is the polynomial 

7 l(x) = (x ~ X 0 ) (x ~ X\) . . . (X ~ X n ) . 


(1.3.10) 


Note that the function / (x 0 , xi ,... , x n ) is a symmetric function of its arguments 
/ (#o) (x n ), since a permutation of xo, x \,... , x n on the right side of (1.3.8) 
changes only the order of its summands. The value of the function / (x n ) can be 
expressed in terms of / (#o) and the divided difference / (xo,xi, • • • , x&), k = 
1,2,... ,n,by 

/ (x n ) = / (x 0 ) + (x n - x 0 ) f [x 0 , Xi] 

+ (x n - Xo) (x n - Xi) f [xo,xi,x 2 ] H- (1.3.11) 

+ {pc n - X 0 ) (x n - Xi) • • • {pc n - Xn-!) f [x 0 , X t% , . . , X n ] . 

In the case when the points x- L , i = 0,1,..., are equally spaced the divided 
differences can be expressed in terms of finite differences. Thus, 


f(x 0 + h)-f (x 0 ) _ A / 0 


f[x 0 ,x 0 + h] 


1 ! h ’ 


h 


f [x 0 + ft, ^0 + 2ft] - / [x 0 , X 0 + ft] _ A 2 /o 


/ [x 0 ,x 0 + ft,^o + 2ft] 


2! ft 2 ’ 


2ft 



/[x 0 ,x 0 + ft,... ,x 0 nft] = 


(1.3.12) 


For creating difference tables, see dif ftabl .f 90, difftabl .m and difftabl .nb 
on the CD-R 

1.3.3. Newton-Gregory Formula. Let us introduce a new variable s by 
defining x = xq + sh. Then 


(x — xq) ... (x — Xk) = h k s(s — 1 )... (s — k + 1 ). 


This result together with (1.3.11) gives the interpolating polynomials p n (x) for a 
function f(x): 



(1.3.13) 


which is known as the Newton-Gregory form of the forward difference formula. 
Then the error term is given by 


E n (x) = /(.!•) -Pn(x) = h n+1 


( n + i) / (n+1) (6), x 0 < < x n . (1.3.14) 
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If we use the backward difference operator, we obtain the backward difference form 

Pn(x) = Pn (X n + sh) = V J /n- (1.3.15) 

1=0 ' J ' 

The error term in (1.3.13) is given by 

fix) - Vnix) = (-1 ) n+1 h n+1 ^ ^ /(” +1 > (6) • (1.3.16) 

Sometimes it is useful in applications to relate finite and divided differences to 
derivatives. Thus, assuming that the points xo,xi,... , x n lie on the interval [a, b], 
we have 


/( X 0 ,X!,... ,X n ) 



Xk-l) 


X 


x dt n ... dt 2 dt\. 


(1.3.17) 

This result can be proved by induction (see Krylov 1962). Notice that the region of in¬ 
tegration in formula (1.3.17) is a simplex in the n-dimensional space (£i, t^, • • • , t n ), 
such that 


0 <t n < t /7 _! < • • • < h < 1. (1.3.18) 


The volume of this simplex is 




dt n ... (id 2 dt i — . 

n! 


Moreover, the quantity 


n 

V = X 0 + ^2 i X k - Xk-l) 
k =1 

— (1 to) T (^i ^2) ^1 T ■ ■ ■ T ( t n —\ t n ) x n —\ T t n x n 5 


which is the argument in the integrand in formula (1.3.17), clearly shows that the 
multipliers of all xk are nonnegative, and since the sum of these multipliers is unity, 
the quantity v is a weighted average of the points Xk, k = 0,1,... , n. Thus, the 
quantity v lies in the interval [a, b ], and, therefore, a point in the interior of the simplex 
(1.3.18) corresponds to an interior point of the interval [a, b\. Hence, after applying 
the mean-value theorem to the integral in formula (1.3.17), we find that if f(x) has a 
continuous derivative of order n on [a, b\, then there exists an interior point is of [a, b] 
such that 

fM(is) 

f(x 0 ,xx n ) = - j —. (1.3.19) 

n\ 
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Thus, Eqs (1.3.12), (1.3.17), and (1.3.19) provide the relationship between the finite 
differences and derivatives, which is 


n t 1 Ptn — l / ' L 

•••/ /<" >(..•„ f//V/,, 

Jo \ k=1 

x dt n ... dt^ dti = h n x 0 < v < x 0 + n h. 


(1.3.20) 


1.4. Interpolation 

In Chapter 2 we will discuss certain quadrature rules which are obtained by integrating 
interpolating polynomials. These rules are called interpolatory quadrature rules. 
Therefore, we first introduce the concept of interpolation and some related results. 

The problem of interpolation stated in a simple form is as follows. When a 
function has been obtained as a set of tabulated values, we may seek this function at 
a value of the argument which is different from the tabulated data. This problem also 
includes extrapolation. Let {fo(x), fi(x),... , f n (%)} denote a set of prescribed 
basic coordinate functions, tabulated at the points xo,xi,... , x n in the interval [a, b\ 
for a < x < b. Then we seek an approximation f {x) of the form 


f(x) « (Af)(x) = ^2 a i /i(A (i- 4 - 1 ) 

i=l 

where the values a$, i = 0, 1 ,... , n, may be computed from the tabulated values of 
f{x) in some prescribed manner. The function ( Af){x) in Eq (1.4.1) is known as 
an interpolant and is often denoted by Pop,... Suppose that the function f(x) 

is tabulated at some distinct points xo, x \,... , x n in the interval [a, b\. Assume that 
det [fi (xj) ] ^ 0. Then there exist unique values ao, a\,... , a n in Eq (1.4.1) such 
that 

n 

fj = f ( x j) = E a *f* ( x i) f or j = 0,1 ,n. 

i =0 

If we take f r (x) as a polynomial of degree r in x, then the interpolant is a polynomial 
of degree at most n. 

1.4.1. Lagrangian Polynomial. The Lagrangian polynomial, which is 
widely used in these problems, has the interpolant defined by 


(Af)(x) = P 0 ,1,.. ,n( x ) = l A x )f ’ 

3=0 


(1.4.2) 
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where 


n 


i A x )=n 


i =0 


Xj — Xi ’ 


The formula (1.4.2) can be written explicitly as 


(1.4.3) 


,n(%) — 


+ 


(x - a?i) (x-x 2 )...(x- x n ) 

(x 0 - xi) (x 0 - x 2 )... (x 0 - x n ) J 

(x - x 0 ) (x-x 2 )...(x- x n ) 

(x 1 - x 0 ) (x 1 - x 2 ) • • • (x 1 -X n ) jl 

(x - Xp) (x - Xi) . .. (x - x n ) 
(x n - x 0 ) (x n - Xi)... (x n - x n - 1 ) 


(1.4.4) 


where fj = f (xj), j = 0,1,... , n, and the error E(x) = f(x) — ( Af)(x ) in this 
interpolation formula is given by 


/ n + x (£) 

E(x) = (x - x 0 ) (x-xi)...(x- x n ) , a < < b, 

[n + lj! 


(1.4.5) 


if / n+1 (£) is continuous and £ depends on x. For interpolation with the Lagrangian 
polynomials, see intrpol. f 90, intrpol .m and intrpol .nb on the CD-R. 


Example 1.4.1. (a) Constant interpolation: n = 0, xo = a, Pq(x) = /(a), 
a < x < b, and E(x) = (x — a) /'(£), a < £ < b, if /'(£) is continuous and £ 
depends on x. 


(b) Constant interpolation: n = 0, xq = 


-,Po(x) = - x - b ' 

E{x) = (x- a < v < b, if /'(p) is continuous and v depends 


and hi[x) = [x — 
on x. 


(c) Linear interpolation: n = 1, xq = a, x\ = b. 


Po,i(x) 


x — b 
a — b 


/(«) 


x — a 
b — a 


m, 


a < x < b, 


and E(x) = \ (x — a)(x — b)f"(r /), a < rj < b, if f"(rj) is continuous and r] depends 
on x. 

(d) Quadratic interpolation: n = 2, x$ = a, x\ = = c,x 2 = 5, 


^ 0 , 1 , 2 <» 


(x — c)(x — 5) 
(a — c)(a — 5) 


/( a ) + 


(x — a) (x — b) 


(c — a) (c — b) 
(;x — a) (x — c ) 


(b — a)(b — c) 


m, 


/(c) 

a < x < 


b, 
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and E{x) = - (x — a)(x — c)(x — b)f '"(£), a < £ < b, if /'"(£) is continuous and 
£ depends on x. ■ 

1.4.2. Neville’s Method. (Also known as Neville-Aitken method, see 
Phillips and Taylor 1996.) The Lagrangian polynomial method often fails to tell 
us which degree of polynomials to use. If the degree is too low, the interpolating 
polynomial does not give a good estimate for f(x), and if the degree is too high, 
the polynomial value may undergo oscillations. This means that we cannot predict 
how many points Xk will be needed to achieve the desired precision in interpolation. 
Suppose we find that the required precision is not achieved for the number of points 
Xk first chosen. Then we must use one or more additional points. But introducing 
one or more points completely changes all the terms in (1.4.4). 

Neville’s method computes the interpolated value with polynomials of succes¬ 
sively higher degree and stops when the successive values converge to a common 
value. It uses the above Lagrangian formula for the linear interpolation, i.e., 


f(x) 


X — X\ x-x 0 , 

Jo H J i 

Xq — X\ X\— Xq 


(x-xi) fo + (xo-x) fl 

X 0 - X\ 


(1.4.6) 


Neville’s Table. Since each successive value is obtained by linear interpo¬ 
lation, we will denote the interpolant Po,i,2,...associated with fi in short by P^o- 
Then, after rearranging the tabulated value in order of closeness to the value of x 
where f(x) is to be interpolated, we construct a table for the linear interpolants for 
i = 0,l;i = l,2;i = 2,3; and so on. The successive computed values are arranged 
in columns, such that the next column contains linear interpolation values from the 
previous column for i = 0, 2,..., and the next column uses these values. This process 
is continued until it runs out of the interpolation pairs. The formula for computing 
the values in the Neville’s table is 


P — 


(x Xi) P i- T ( Xi+j x ) P ij— i 

X^-^-j Xi 


(1.4.7) 


To implement this method, see neville. f 90, neville. m and neville. nb on the 
CD-R. 


Example 1.4.2. Consider the tabulated data: 


Table 1.4.1. 


X 

10.2 

23.5 

33.4 

42.7 

54.1 

f{x) 

0.98419 

0.91706 

0.83485 

0.73491 

0.58637 


and interpolate /(29). 

First, we arrange the values in order of closeness to x = 29; this is done by using 
the values of \x — Xi \. 
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Table 1.4.2. 


i 

\x - Xi\ 

Xi 

PiO 

0 

4.4 

33.4 

0.83485 

1 

5.5 

23.5 

0.91706 

2 

13.7 

42.7 

0.73491 

3 

18.8 

10.2 

0.98419 

4 

25.1 

54.1 

0.58637 


By using formula (1.4.7) with x = 29, the Neville’s table is 


Table 1.4.3. 


i 

Xi 

PiO 

Pn 

Pi2 

Pi3 

P 14 

0 

33.4 

0.83485 

0.87138 

0.87446 

0.87466 

0.87462 

1 

23.5 

0.91706 

0.86488 

0.87517 

0.87450 


2 

42.7 

0.73491 

0.83999 

0.87143 



3 

10.2 

0.98419 

0.81382 




4 

54.1 

0.58637 






The top row of the above table represents the Lagrangian interpolants at x = 29, 
where the second subscript of Pij is equal to the degree of the polynomial. The values 
converge to 0.87462, which is obtained for j = 4. The original data contains the 
values of f(x) = cos x, where x is in degrees; the exact value of cos 29° = 0.87462. 
Note that the rearrangement of the table in the order of closeness to x = 29 brings 
out the convergence faster by centering the x- value relative to the prescribed data. ■ 

1.4.3. Osculating Polynomials. The expression for lj(x) in (1.4.3) or the 
interpolant (1.4.4) becomes indeterminate if some of the points Xi coincide. In such 
cases we must find a new form for Po,i,... , n (x). The interpolant is then called an 
osculating polynomial. Some examples of osculating polynomials are given below. 

Example 1.4.3. (a) Truncated Taylor Series, when x$ = x\ = ... = x n = a. 
The interpolant is 

Po,... ,oO) — f( a ) + (x — a)f'(a) + • • • + -—^ ^ /^( a )> 

and the error is given by 


E(x) = f(x) - P 0 ,... ,o(x) = 1 f (x- t) n f(n + l)(i) 

n • Ja 


dt 


(■ x - a ) n+l f(n+ l)rn 

(n + 1)! J 


a < £ < x, 
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if /( n+1 ) (x) is continuous for a < x < b, and £ depends on x. 

(b) Two-Point Taylor Interpolation. Let n = 2 m — 1, Xq = xi = ... = x m _i = 
a, and = x m+ i = ... = X 2 m -i = b. Then the error is given by 

E(x) = f(x) - P 0> ... ,o,n,... ,n( x ) = — — a ^2m)! - / (2m) D> a < t] <b, 

iff (2m) 

(x) is continuous, and r\ depends on x (see Davis 1976, p.37). ■ 

Instead of approximating / (x) by an osculating polynomial over the interval [a, b \, 
we partition the interval, say, by a = x$ < x\ < ... < xjy = b , and interpolate f(x) 
separately over each subinterval [xi,Xi+ 1] by a suitable interpolating polynomial. 
This method is known as the piecewise-polynomial interpolation. The method 
simplifies if Xi = x + ih , where h = (b — a )/TV. The resulting interpolant is denoted 
by ,iv(#) for each piecewise interpolating polynomial. 

Example 1.4.4. (see Baker 1978, p.90) In the examples (a)-(c) of piecewise- 
polynomial interpolations given below, it is assumed that Xi = xq + ih. 

(a) Piecewise-Constant Interpolation (see Example 1.4.1). 


f(x) « (Af)(x) 


f(xi ) if Xi < x < x i+1 ,i N - 1, 
/( x N -i) ifx N -i < x < x N ; 


error = \f(x) — (Af)(x)\ < h max |/ , ('C)| if /'(£,) is continuous. 

a <^<6 


(b) Piecewise-Linear Interpolation (see Example 1.4.1). 


/( x) « (. Af)(x ) = f (x i+1 ) - / t+1 / (Xi), Xi < x < x i+ i, 

h 2 

error = I f(x) — (Af)(x) I < — max |/"(£)| if/ /r (£) is continuous. 

2 a<^<6 

(c) Take ( Af)(x ) as a piecewise two-point Taylor interpolating polynomial (see 
Example 1.4.3) of degree n = 2m — 1. Then the approximation A(f)(x) has a 
continuous (m + l)-th derivative. If m = 2, then n = 3, and we obtain a polynomial 
which is piecewise cubic and has a continuous first derivative with error 

error = \f(x) - (. Af)(x)\ = - a )'/~ ^ a < £ < b. . 


1.4.4. Richardson Extrapolation. This method is used for the numerical 
differentiation of a known function f(x). It uses smaller //-values rather than the 
larger ones as is the case when the function is known only in a tabulated form. Thus, 
we start with an arbitrary value of h and compute 

ft, ^ _ f{x + h) - f(x - h) 

J \ x ) ~ o r. 
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Then we take the value of h half as large and compute the second value of f'(x ), and 
a third value with half of the previous h- value, and so on, for the first approximations; 
we stop only when the computed values do not differ from each other. For the 
subsequent approximations we extrapolate by using the formula 

better estimate = second value + ^ (second value—first value), (1.4.8) 

where the ‘second value’ refers to the value of f'(x) computed with the halved h- 
value. Since the first approximations have errors of order 0(h 4 ), so n = 4 in formula 
(1.4.8). The higher-order extrapolations use the h -values halved at each stage. The 
convergence is achieved when two consecutive approximations yield the same result. 
For clarity the results of each extrapolation are presented as a table. To create a 
Richardson extrpolation table, see extrpol. f 90, extrpol .m and extrpol .nb on 
the CD-R. 

Example 1.4.5. Use Richardson extrapolation for f(x) = x 2 sin x to compute 
/'(l.5), taking h = 0.1 (see Table 1.4.5). The exact value is /'(1.5) = 3.15164. For 
computational details, see richard. nb on the CD-R. ■ 


Table 1.4.5. 


3.13713 

3.14801 

3.14874 






3.15074 

3.15092 

3.15106 





3.15142 

3.15146 

3.15150 

3.15153 




3.15159 

3.15160 

3.15161 

3.15161 

3.15162 



3.15163 

3.15163 

3.15163 

3.15164 

3.15164 

3.15164 


3.15164 

3.15164 

3.15164 

3.15164 

3.15164 

3.15164 

3.15164 


1.4.5. Error Bounds in Polynomial Interpolation. Let f(x) E 

C n+1 [a, b\, and let its interpolant Po,i*... ,nW be a polynomial of degree at most 
n such that both the function f(x) and the interpolant have the same values at the 
points xo, xi ,... , x n G [a, b\. Then, in view of the Rolle’s theorem we have for 

a < x <b 


n 

f(x) - Pox ... ,n ( X ) = II ( x - x i) 

i=0 


f {n+1) (0 

(n +1)! ’ 


a < £ <5, 


(1.4.9) 


where £ depends on x, and each point x % is counted according to its multiplicity. Then 
we obtain an error bound 


||/(^)-P0,l,...,nN>|| oo < 


n 

]4 {x - Xi) 
i=0 


oo 


l|/ (n+1) N)L 

(n + 1)! 


(1.4.10) 


provided ||/ ( ' n+1 H x )|| 00 known. However, in those cases when f^ n+1 \x) does 
not exist or cannot be easily estimated, an error bound can be found with a lower 
order estimate. 
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In the case of distinct points x % , i = 0,1,... , n, the following result is useful. 
Let f(pc) G C [a, b], and denote 

E n (f)= inf { sup \f(x) -p„(ar)|j = inf ||/(rc) -p n (a:)|| oo , (1.4.11) 

P™ ^ a<x<.b ' P n 


where p n (x) is a polynomial of degree n. The modulus of continuity 6) associ¬ 
ated with the function f {pc) is defined by 

oj(f; S) = sup {1/(2;) — f(y)\ suchthata<x,y<b,\x-y\<6}. (1.4.12) 


Then, we have 


if 


E n (f) < 


7 v(b — a) L 
4 (n + 1) 


f(x i) - f{x 2) < L\xi -x 2 


holds for all x \, x^ G [a, 6]; and 


^n(/) < 


~7r(b — a)^ k 

. 4 . 


ll/ (fc) N>IL 

(n + l)n... (n — k + 2) ’ 


(1.4.13) 

(1.4.14) 


(1.4.15) 


if A' - 1 (a;) is bounded on [a, 6] and n > k. The bound (1.4.13) is known as Jackson’s 
theorem (see Cheney 1966, Rivlin 1981). It says that /( x) is Lipschitz-continuous 
when it satisfies the Lipschitz condition (1.4.14). Also, the results (1.4.13) imply that 


E n (f) < U 


( 7 r(b-a) \ 

\ ’ 2(n + 1) / ' 


(1.4.16) 


The bound (1.4.15) is proved in Cheney (1966, p. 148). 

If we use a polynomial r n (x) of degree n for which E n (f ) = 11 / {x) — r n (x) 11 , 
then, in view of (1.4.2), for distinct points xq, x\ ,... ,x n , we obtain 


||/(*)-- P 0,l,...,n(*)|| oo = ||/(*)-£ij(*)/(*j) 


3=0 


< II fix) - rn^lR + II hd) { r n dj) - f (Xj) } 


3=0 


n 

<{l + \\YH-)\\\J E nd). 


3=0 


The number 

n 

Ln = \\Y H X )\ 

3 =0 


(1.4.17) 


(1.4.18) 
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is called the Lebesgue constant for polynomial interpolation. The size of this 
number depends on n and the distribution of the points x : j , j = 0, 1 ,... , n, and the 
points a and b, since || f(x) || = sup \f(x)\. 

a<x<b 


Special Cases. 


(i) For a = —1, b = 1, and Xj 


cos (2 j + 1)tt 
2(n + 1) 


, j = 0, 1 ,... , n, the number 


L n < 2 tt Inn+ 4 (see Powell 1968,Rivlin 1981). Note that — Inn —> Oasn —> oo. 

n 

Then with the above choice of Xj and [a, b] = [—1,1], we have 


\im o \\f(x)- p 0 A ,..., n (x )\\ oo =0 


provided that f(x) is Lipschitz-continuous. The points x :j are the zeros of the 
Chebyshev polynomial of the first kind T n+ i(x), which is defined by T n+ \{x) = 
cos[(n + 1) arccosx] if \x\ < 1 (see (1.4.2)). 

If we take a = 0, b = 1, we obtain the same result as in case (i) provided Xj are 
taken as the zeros of the shifted Chebyshev polynomial ^n+ l( X ) — T n + l(2x 1), 
since the value of L n is the same in both cases. 

(ii) For the general distribution of the points x 3 , j = 0,1,... , n, and an arbitrary 
function f{x) G C[a, b\, it is not true that lim II f(x) — Poi ... n(%) II = 0 (see 

Natanson 1964, and Cheney 1966), but Po,i, -- ,n( x ) does converge in the mean to 
f(x) (see Natanson 1964, p. 56). Note that if a = —1, b = 1, and Xj are the zeros of 
the Legendre polynomial P n + \ (.t), then 

n 1 ™ o l|/L)- P 0,l ) -.. > n(^)|| oo =0. 


1.4.6. Newton-Gregory Forward Polynomial. This polynomial passes 
through a finite set of equidistant points, and is defined by 

Pn ( x s) = /o+ (^j ^/o+ - ^ (n — l) ^ (1-4-19) 

where h is prescribed, s = (x — xo) /h, and 

fs\ = si = s(s-l)...(s-j + 1) 

(s-j)ljl j\ 

The error in (1.5.9) is given by 


E(x s ) = h n+1 ^ S + ^ r +1 (0, a < £ <b. (1.4.20) 
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1.5. Semi-Infinite Interval 


Let the interval [0, oo) be partitioned into equal subintervals of length h > 0 by the 
points Xk = kh , k = 0 , 1 , 2 ,, and let the values of a function / at these points be 
denoted by / (x k ) = f(kh) = f k . 

1.5.1. Linear Interpolation. Consider the interval [kh, (k + 1 )h\, and 
linearly interpolate a function f(x) with respect to the values at the two endpoints: 

/M = x-(t + 1) >. A + £ _». /w+EtK/ ) (151) 


Then, if / G C 2 [kh , ( k + l)/v], the error E k {pc, f) is given by (Krylov and Skoblya 
1977, p. 171) 

E k (x, f ) = h 2 f 1 f"(kh + rh) [(£ - r)U(f - r) - C(1 - T)} dr, (1.5.2) 
7o 

where x = x k + £ h = (fc + £)ft, 0 < £ < 1 . 

1.5.2. Quadratic Interpolation. Consider the interval [fcft, (fc + 2) ft,] of 
length 2ft, and interpolate the function / with respect to the values f k , //c+i, and 
fk +2 at the points kh , (ft + l)ft, and (ft + 2)h with a polynomial P 2 (x) of degree 2 . 
Then the parabolic interpolation is 


(x - x k+1 ) (x - x k+2 ) , , (a; - x k ) (x - x k+2 ) , 
J\ x ) =- / ol\ -/fc “I- 1 TT7T\ -/fe+i 


(- h)(-2h) 

(x ~ x k ) (x - x k+1 ) 


fk +2 + E k (x, /), 


(1.5.3) 


(h)(2h) 

which is analogous to the Newton-Cotes parabolic rule (see §2.4.) To find the error 
E k ( x ), we use the Taylor’s formula with remainder in the form of an integral: 

— t ) 2 dt 


f{x) = fk + {X- x k ) f k + ^(x- x k ) 2 fk J - t) 

, , If 

= P2(x) + ~ / 

Z J X 


Xk + 2 

- t) 2 U(x — t) dt = P 2 {x) + q(pc). 
x fc (1.5.4) 


Since the polynomial P 2 (^) is interpolated exactly, the interpolation errors of f(x) 
and q(x) are the same. Thus, 

1 pX k +2 

E k {x,f) = - / /'"(*) [(z-i) 2 C(a;-i) 

Z Jx k 

+ (*-*»>(*-*»+*> {n+1 - tf u (%+1 - ,) 

(xw _ tf]dt (L5 . 5) 
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Since U (xk —t) = 0, and U ( Xk+2 —t) = 1 for all t < Xk+ 2 , we obtain the 
simplified expression for Ek(x) by introducing new variables £ and r by setting 
x = Xk + £/i and t = Xk + rft, 0 < £, r < 2. Thus, 

/) = y / ( Xk+Th _ r ) 2f v - L 

+ £(£ - 2)(1 - t) 2 C(1 - r) - i £(£ — 1)(2 — r) 2 ] df. (1.5.6) 

1.5.3. Cubic Interpolation. There are three cases, as follows. 

1.5.3(a) Cubic Interpolation with Four Single Points. The rule for 
the interpolation of degree 3 are analogous to the Newton-Cotes 3/8-rule (see §2.4). 
We take 4 points Xk, Xk+ i, Xk+ 2, and Xk+ 3, and interpolate / with respect to values 
at these points: 


= (x - a^fc+i) (x ~ Xk+2) (x - Xk+3) ^ 


(—h)(—2h)(—3h) 

(X - Xk) (x - Xk+2) (X - Xk+3) 

h(-h)(h) 

(X - Xk) (x - Xk+l) (x - Xk+3) 
( -h)(h)(2h ) 

(X ~ X k ) (X - Xk+l) {x_ ~ fffc+ 2 ) 

(3h)(2h)(h) 


f 'fcH—h 1 
fk +2 

fk +3 + Ek(x, /), 


(1.5.7) 


1.5.3(b) Cubic Interpolation with Two Double Points. Over the 
interval [kh, (k + 1 )h\ interpolate / at the points Xk, and Xk +1 with respect to the 
values fk, fk+ 1 , /(., and fl+i at these points by using a polynomial of degree 3: 


/(*) = 


(x-Xk+lY 


h 2 

(x--Xkf_ 

h 2 


1 + 2 

1-2 


x-x k 

h 

% %k -\-1 


h 


) fk + (x- Xk) fk 


) /fe+1 + (x-x k +i) f k+1 + E k (x, /). 

(1.5.8) 


By using the Taylor’s formula we get 

f{x) = fk + (x- Xk) fl + ^(x- Xk ) 2 fk 

+ l (x - Xkf fk + ^ [ f {A \t)(x-t) 3 dt 

1 pXk+1 

= P 3 (x) + - / f^\t){x-t) 3 U(x-t)dt, (1.5.9) 

^ Jxk 
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where the error Ek(x, f) is given by 


Ek(x,f) = ^j f (4) (t)^(x-t) 3 U(x-t) 


(x - x k y 
h 2 


1 - 2 ^ Xk+1 ) (x k+1 - tf 


h 


+ 3 (x - x k+1 ) (x k+1 -t) 


dt 


= yJ 0 ^ (4) ^ Xk+Th ^ _ T ^ u ^ _ r ) 

- C 2 [(3 - 2£)(1 - r) 3 + 3(£ - 1)(1 - r) 2 ] } dr 

= ~qJ 0 ^ (4) ( Xk+Th ) _ t ) 3u (£ - t ) 

+ C 2 (l-r) 2 [(3-2C)r-^]}dr, (1.5.10) 


where we have set x = Xk + t = Xk + rfo, 0 < £, r < 1. 

1.5.3(c) Cubic Interpolation with Three Double Points. Over the 
interval [fcft, (fc + 1 )h\ interpolate / at the points %k+i> and #&+2 with respect to 
the values f k , f k+1 , f k , f' k+l , f k+2 , and f' k+2 at these points: 


f(x) = M- ? 

j =0 ( X — x k+j) \TT k (x k+j )] 2 


+ ( x ~ x k+j) /fc+j j + Ek(x , /), 


fk+j 

(1.5.11) 


where i t(x) = (x — x^) (x — Xk+i) (x — Xk+2)- The interpolation error is given by 

(1.5.12) 


E k (x,f) = ^P-f {4) (x k + 0 k h), 0 < 6 k < 2. 

6 ! 


1.5.4. Transformation to the interval [0,1]. Consider the functions / 
that satisfy the condition \f(x)\ < Ax~ s , s > 1, A > 0, for large values of x. 
Among such functions we choose those functions F that can be represented in the 
form 


F(x) = (1 + x) s f(x), s > 1, 

where / E C[0, oo), such that lim F(x) = F( oo) < +oo. Thus, such functions F 

X^-OO 

are regarded as continuous on the closed interval [0, oo] and the finite limit value F(oo) 
is taken as its value at the point at infinity. For the sake of simplicity, we consider as 
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the basic function the system of simple fractions 1/(1 + x) m , m = 0,1,2 ,..., and 
interpolate by using the polynomials in the argument 1/(1 + x), i.e., 

Pn(x) = ]T • (1.5.13.) 

771 = 0 ' ' 

These polynomials form a complete system in the metric in the set of functions 
F{x) G (7[0, oo]. Then the transformation z = — carries the half-axis [0, oo] 

into the interval [0,1], and the function F{pc) which is continuous on [0, oo] goes into a 
function G{x) continuous on [0,1] on the real z-axis, and the rational functions p n (x) 
go into the polynomials p n {z), which, by Weierstrass’ theorem, form a complete set of 
algebraic polynomials in the class of functions continuous on a finite closed interval. 

If on the half-axis [0, oo) we take n + 1 points Xk such that 0 < xo < x\ < ... < 
x n < oo and choose the coefficients of the function p n {x) so that its values at the 
points Xk coincide with the values of F: 

n 

Pn (Xk) = (1 +Xk)~ l = F(x k ), k = 0, l,...,n. (1.5.14) 

i =0 

Then we obtain a linear system of equations to determine the coefficients a&, which, 
while solving the system (1.5.14), turn out to be linear functions of F ( Xk)- Their 
substitution into (1.5.13) will show thatp n is also a linear function of F (xk), that is, 

71 

Pn(x) = ^2lk(x)F(x k ), (1.5.15) 

k=0 

where lk(x) are polynomials of degree n in 1/(1 + x) and are known as the influence 
functions of the interpolating points Xk and satisfy the conditions r* (xk) = 8ik- 
Thus, 


i k = f\(— -— 

iVi+a: 1 + Xj 


1 + Xj 


(1.5.16) 


The above coefficients h(x) differ by very simple factors from the Lagrangian mul¬ 
tipliers which, as in (1.5.13), are defined by 


1 ( ) = O+XkT 7Tn+l {x) 
lk[X) ~ (1+x)- (x-X k )^ n+1 (XkY 

71 

K n +i{x) = P[ (x - Xj). (1.5.17) 

j =o 
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If we expand the polynomial 


7Tn+l ( X ) 
(x - X k ) 


into powers of 1 + x, we get 


Kn+l(x) 
(x - X k ) 


N C ^m (1 + X ) 

m =0 


and after substituting this expansion into (1.5.17) and (1.5.15), we have 


Pn(x) = J2 F (Xh) ^2 C ™ 

k=0 771=0 


(i + M n i 

K+l (Xk) (1 + x) n ~ m 


(1.5.18) 


in which the factors in front of (1 + x)~ n+rn can be computed at the points 
k = 0,1,... , n. Under the transformation z = 1/(1 + x), the error term Ek(x) = 
F{x) — Pn(x) becomes e n (z), and is given by 

e n (z) = ( ~/ } , n+1 £ G (n+1 )(r) {(r - z) n U(r - z ) 

n 

- ^2 ++) ( r _ Zk ) n u(r- z k ) ) dr, (1.5.19) 

k =0 

where 

/ \ n 

^=(*-$1 (.-,)• 

We can use the inverse transformation to obtain E n (x) from (1.5.19). Thus, we set 
t — 1/(1 = 1/r — 1, and after a lengthy calculation (see Krylov and Skoblya 

1977, pp. 207-210), we obtain 


En{x) = i Dn+l{F) ^yy 

n 

y — 

(nr. — 


+ x) 

Kn+l(x) {Xk ~ t) 

'-^ o (X - X k ) < +1 (X k ) 1 + t 


(x — t) n U(x — t) 


■U(x k - t) 


dt , 


(1.5.20) 


where 


71+1 

Dn+l(F) = J2 On-j+1 (1 + t) j F U) (t), «0 = 1. 

3 = 1 


Note that for t < +, +q,... , x n , the interpolation is exact and the quantity within 
the braces in (1.5.20) vanishes; otherwise, the functions U{pc —t) and U (x x — t ) are 
equal to zero and the error is also zero. The quantity within the braces in (1.5.20) 
takes nonzero values only on the interval where x,xq,. .. , x n are located. Hence, 
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in view of the continuity of D n +i(F), the integral over [0, oo) is a proper definite 
integral. 


1.6. Convergence Accelerators 

We discuss some convergence acceleration processes that are useful in quadrature. 

1.6.1. Fixed-Point Iteration. To compute the root of an equation f(x) = 0, 
we rearrange f(x) in an equivalent form x = g{pc) and use the result that if f(z) = 0 , 
where z is a zero of f(x), then z = g(z). The value z is known a fixed-point of the 
function /. Thus, the iterative form 


x n +i = g (x n ) , n = 0 , 1 ,..., (1.6.1) 

converges to the fixed point z of f(x). The fixed-point algorithm is: 

Rearrange the equation as an equivalent form x = g(x). 

Set X 2 = x\\ 

REPEAT 

Set x\ = X 2 , 

Set X 2 = g(x i). 

UNTIL \x\ — X 2 \ < tolerance. 

The criterion for the convergence of the sequence {x n } is as follows: If g E C 1 
on an interval about a zero z of the equation x = g(x) and if \g'(x) \ < 1 for all x in 
the interval, then the sequence {x n } defined by ( 1 . 6 . 1 ) converges to x = z, provided 
Xi are chosen in the interval. 

Example 1.6.1. Let f(x) = x 2 — 2x — 3 = 0, which has the zeros —1 
and 3. Let a rearrangement be x = g\ (x) = yj2x + 3. If we start with x = 4 
and iterate with the fixed-point algorithm ( 1 . 6 . 1 ), we find the successive values as 
x 0 = 4; x\ = 3.31662; x 2 = 3.10375; x 3 = 3.03439; X 4 = 3.01144; x 5 = 
3.00381; xq = 3.00127, which appear to be converging to the zero x = 3. 

If we take the other rearrangement x = g 2 (x) = 3/(x — 2), and start with 
x = 4, then the fixed-point algorithm yields the following sequence of values: xq = 
4; x\ = 1.5; x 2 = — 6 ; x 3 = —0.375; X 4 = —1.26316; x$ = —0.0919355; xq 
1.02702: x 7 = -0.990876; x 8 = -1.00305; x 9 = -0.998984; x 10 = -1.00034, 
which appears to converge to—1. A third rearrangement is x = g 3 (x) = (x 2 — 3) /2, 
and if we start with x = 4, the sequence of values is xo =4; x\ =6.5; x 2 = 
19.625; x 3 = 191.07; X 4 = 18252.4, and the sequence diverges. This behavior in 
the three sequences is interesting. Notice that the \g'(x) \ is positive but less than 1 in 
the first case; thus the convergence is monotone. In the second case | g' (x) | is negative 
and less than 1, and the convergence is oscillatory. In the third case \g'(x) \ > 1, and 
the iterates diverge. ■ 
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1.6.2. Aitkin’s A 2 Process. This is simply a formula that extrapolates 
the partial sums of a series whose convergence is approximately geometric. In a 
sequence of values each error is approximately proportional to the previous value. 
This is the basis for an acceleration technique for convergence. Assume that the three 
consecutive errors E n , E n+ 1 and E n + 2 are defined by Ei = Xi — r = K % ~ x E\ for 
i = n,n + l,n + 2. Then the three successive estimates of the zeros are given by 

Xi = r + K % ~ x Ei, z = n + l,n + 2. (1.6.2) 

Using this value of we find 


x n x n-\-2 X n-\-l 
^n+2 2 X n -\. 1 X n 


Thus, from these three successive estimates, we start with x\, x<z and xs and extrap¬ 
olate to an improved estimate. However, the assumption of constant ratio between 
successive errors is generally not true, and the extrapolated values, though improved, 
are not exact. An alternative method to avoid the round-off error that occurs in 
subtracting large numbers of nearly similar magnitude cosists in using the forward 
differences. Thus, define 

A Xi = Xi +1 — Xi , 

A 2 Xi = A (A Xi) = A (x i+1 - = x i+2 - 2 x i+1 + x t . 


Then Aitkin’s acceleration scheme is 

(Ax n ) %n ^n +2 2 X 2 _|_ 1 

V = Xn ~^2 - = -^- 1 - ( L6 - 3 ) 

A x n x n j r 2 2x n _)_i T x n 

The criterion to justify when to use Aitkin’s acceleration is as follows: Given x n , 
x n+ i, x n+ 2 ? ^n +3 for some n, compute 


C = 


n+2 

E X i X i +1 

i=n 


n+2 n+2 

I E x i E x i +1 

i=n i=n 



(1.6.4) 


Then Aitkin’s acceleration is most effective if C is close to unity. Note that Aitken’s 
method can also be used on sequences other than those generated by fixed-point 
iteration. 
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Example 1.6.2. Consider the same / as in Example 1.6.1. Then x n +\ = 
y/2x n + 3. We start with X \ = 4. The extrapolation is given in Table 1.6.2. 

Table 1.6.2. 


X 

Ax 

A 2 x 

x\ = 4.000 

0.683375 


x 2 = 3.31662 

0.212877 

0.470498 

x 3 = 3.10375 




The accelerated estimate is r = 4.0 — 


(0.683375) 2 


= 3.00743. Using the value 


0.470498 

of xq = 4, x\ = 3.31662, X 2 = 3.10375, and x$ = 3.03439, we find that 


C = 


32.9764 - i (10.4204)(9.45476) 
a/(36.6332 - 36.1847) (29.8408 - 29.7975) 


= 0.973095. 


See Jones (1982) for other extensions to improve the acceleration technique. 

Alternatively, we define Aitken’s A 2 -algorithm as follows: Given a sequence 
{xo, x 2 , • • • } that converges to £, compute the sequence {£i, x 2 ,... } by the 
(Ax n ) 2 


formula x n = x n +\ — - 


This is known as Aitkin’s A 2 process; it is applicable 


A 2 a; n _i 

to any linearly convergent sequence. 

If the sequence {xo, # 1 , # 2 ? • • • } converges linearly to £, i.e., if the error £ — 
x n +i = K (£ — x n ) + o (£ — x n ) for some K ^ 0, then x n = £ — o (£ — x n ). Also, 

r Ax k Ax k +! 


if from certain k onward, the sequence of difference ratios 


lAafc-i’ Ax k 




is almost constant, then x k can be taken as a better approximation to £ than x k . In 
particular, \x k —x k \ then becomes a good estimate for the error \^ — x k \. If we reach 
a certain x k which we decide as a much better approximation to £ than x k , then the 
process stops, and we start the fixed-point iteration with x k as an initial guess by 
using the Steffensen’s iteration which is defined by 

Steffensen’s Algorithm. Given the iteration function g(x) and a point yo. 


For n = 0,1, 2,... , until satisfied, do 

Set Xq — y n 

Compute x\ = g (xo), x^ = g (x\) 
Compute d = Ax\, r -1 = Axq jd 
Compute y n + 1 =x 2 + d/ (r -1 - l) 
enddo 


A Fortran program for this algorithm is provided as ait ken. f 90 on the CD-R. 
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The Steffensen’s algorithm is combined with an ordinary fixed-point iteration as 
follows: Initially, we use fixed-point iteration to generate the iterates #o, x \, ..., 

and also to compute the ratios rf 1 , 1 ,-When these ratios become sufficiently 

constant, we switch over to Steffensen’s iteration. The program terminates if v > 
ntol or | g ( x n ) — x n \ < xtol, where ntol denotes the upper bound on the number 
of steps to be carried out and xtol is a given absolute-error requirement. 

1.6.3. Shanks Process. Shanks (1955) uses the idea of fitting the elements 
A r of a sequence {7L r },r = 0,l,2,..., to a predefined form which has free constants, 
and then computing these constants, such that the limit of the predefined form yields 
the estimate of the required limit. The sequence of the estimated limits itself forms a 
sequence, which should converge faster than the original sequence to the same limit. 
Shanks uses the predefined form 


k 

A r = Bfrn + E a ik Qini Qin 7^ 1 or 0? f° r n — k < v < n + k , and n > k, 

(1.6.5) 

where the term B^n is known as the local base. It is obvious that B^n approaches 
the required limit as r —> oo. Hence, there are 2k + 1 nonlinear equations for the free 
constants B^ n , otin and ^ n , and we are required to compute ^ n . 

However, these nonlinear equations can be solved by using the following results: 

k 

If the quantities p s are defined by p s = a* qf, s = 0,1,... , 2k — 1, then qi are 

2=1 

the roots of the equation 


1 

q •• 

. q k-l 

qk 



Po 

Pi • • 

• Pk-1 

Pk 



Pi 

P2 * • 

Pk 

Pk+ 1 

= 0. 

(1.6.6) 

Pk- 1 

Pk • • 

• P2k-2 

P2k-1 




Thus, by taking the forward differences of successive equations in (1.6.5), and re- 
placing p s by A A n _ k+S and a, by o, n |g" fe -fe+1 - q™~ k \, we find from (1.6.6) that 
q n are the roots of the equation 


1 Q 

AA-n—k A.A n _£_|_i 


q* 

A Ar, 


A4-i A A n ■■■ AA, 


n+k— 1 


= o, 


or 


Cn Q k + c n -1 q n 1 + • • • + c n -k — 0, 


(1.6.7) 


where Cj denotes the minors obtained by expanding the determinant on the left side 
of (1.6.7) by its first row. If we substitute the expansion for Aj from (1.6.5) into the 
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expression 


C-n—k A n — k + • • • + Cn—1 A n —\ + C n A n 
c n — k 


+ • • • + c n -1 + c m 


which is the expansion by its first row of the ratio 


A-n—k 
AA n _ k 
AA n - k -\-1 


A-n—1 A n 

Ai n -i AA n 

A A n Ai n+ i 


AA n -i 

1 

A A n — k 
A^n-fc+l 


A-An-fe-2 

I 

Ai n -i 

AA n 


AA n+ fc_i 

I 

AA n 

A^n+l 


— B n k- 


( 1 . 6 . 8 ) 


A4_! 


A^n-fc -2 AA n _|_^_i 


Some simple cases of this process are: 

Case 1. With determinants of order 2 (i.e., k = 1), we obtain from (1.6.8) the 
well-known Aitken’s extrapolation formula 


A n — 1^4-n+l 
A n -\-l 2A n + A n _i 


(1.6.9) 


which can be applied to successive sequences of three terms and generates a new 
sequence {Bi n , B^ n • • • }, often denoted by the operator e\, where 


ei (A) = {B ln ], n> 1. (1.6.10a) 

The general form of this operator is e k which is defined by 

e k (A) = {B kn }, n>k. (1.6.10b) 


Another operator, known as the diagonal operator e d , is defined by 


e d (a) = {B nn }. (1.6.10c) 

These operators are used to generate a table of new sequences, in which the first 
column is the original sequence, the second is ei, the third e<z, and so on; the operator 
e d then appears at the top of the table, which is known as the Shanks table and can be 
extended until the desired convergence is achieved. Alternatively, we can use simple 
transformation repeatedly by applying e\ to the second column to get the third, thus 
obtaining columns with the transformations e± f e\, and so on (see Example 1.6.3). 
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Example 1.6.3. Consider the coefficients A n in the Taylor’s series for ln( 1 +x ): 


= E 

3 = 1 


(—1) J+1 2 J 


3 


The results of the above transformation are given in Table 1.6.3, which exhibits the 
rapid convergence to the limit value of In 3 « 1.0986122886. 


Table 1.6.3. 


k 

A-fz 


1 

2.0 


2 

0.0 

1.142857 

3 

2.66667 

1.114492 

4 

-1.33333 

1.0988056 

5 

5.066667 

1.0986256 

6 

-5.6 

1.09861323 


1.6.4. e-Algorthm. The use of e-algorithm (Wynn 1956) with the Shanks 
accelerators makes the process very effective. The e-algorithm uses the recurrence 
relations 


e 

e 


o 1 = 

2 = A*, 


e 


(p) 

n 


>-2) 
fc n+1 


'(P~ !) 
fc n+1 


_ Ap- 1 ) 

c n 


( 1 . 6 . 11 ) 


Then in terms of these e-values the accelerated sequences are given by B^ n = 
which yields a table of the form 


.(-i) 

.(-i) 

.(-i) 

.(-i) 

.(-i) 

.(-i) 


e (0) 

e o 

e (0) 

e i 

e (0) 

e 2 

e (0) 

e 3 

e (0) 

e 4 


4 1} 

e (1) 

e 2 

e (1) 

e 3 


e (2) 

e o 

e (2) 

e i 

e (2) 

e 2 


4 3) 

j 3 > 


e 


(4) 

0 


{An} {B\ n } {B2 n} 


where the columns for the sequences {A n }, {Bi n } and {T? 2 n} are marked in the last 

( 2 ) 

row. This table is constructed by taking the first three A-values and the values of eg 
are found. Then two more A -values are added and the table is completed through 
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6 q^ . Depending on the desired convergence, the process is continued row by row, 
until a suitable agreement is found in the new sequence, at which time the process 
is terminated. For details of this and other transforms, see algorithms.pdf on the 
CD-R. 

1.6.5. Levin’s Transformation. In some cases the predetermined form 
(1.6.5) fails to be generated in the Shanks process; an example is A r = 1/r 2 . Levin 
(1973) improved upon the Shanks transformation by assuming that 


k -1 

A r = T kn + Ry V 7 in fi(r), n < r < n + k, (1.6.12) 

i =0 


where 7 i n are free to force the fit to the given sequence, and R r and fi(r) are chosen 
to provide a range of different methods. Thus, Eqs (1.6.12) form a system of linear 
algebraic equations which yield 


A n A n -\-i 

Rnfo(n) Rn+ifo(n + l) 

Rnfl(n) Rn+lfl(n+l) 


A n -\~k 

Rn+kfofa T 
R n +kfi(n + k ) 


Rnfk—lip^) ^n+l/fe—l(^f 1) 


Rnfo(p) Rn+lfo(p+l) 

Rnfi(n) Rn+ifi(n + l) 


Rn+kfk -1 ( n + fc) 


1 

Rn+kfo {71 T &) 
Rn+kflfo T k) 


Rnfk-l(p) Rn+lfk-l(n + 1) 


Rn+kfk-\(n + k) 


If we take fi(r) = r 1 and divide successive columns by i? n , R n +i , • • • , R n +k and 
the expansion by the first row, we get 


Tkn = 


&-<) m 


n + j \ k 1 A n +j 
Rn+j 


U-o m 


n + j 


k-l 


(1.6.13) 


R. 


n+j 


1.6.6. t- Transformat ion. This transformation is obtained if we set R r = 
a r = Ai r _i in (1.6.12). This yields the operators tk and t d , which are defined 
analogous to e k and e d , by 


tk(A) = {T kn }, t d (A) = {T n 1 }. (1.6.14) 


There are two modifications of the ^-transformation, depending on the following two 
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different choices of R r : (i)lfR r = ra r , we get the ^-transformation with the formula 


k \ / TL + j \k ^ A n _|_j 


Ukn — 




R 


n+j 


&<-*(}) O 

with the corresponding operators 


A—1 


(1.6.15) 


a n+j 


^fc(^) — \Ukn\i ^d(^) — {^nl}- 


(ii) This is the Shanks transformation of the t-transform, which is obtained by writing 
the Aitken extrapolation rule (1.6.9) as 


„ { A\ _ A n —1 d>n -\-1 _ A , ^n+1 

^1 v^Jn — — H 5 

^n+1 ^n+1 


which, by taking 7? r = a r a r + i/ (a r +i — a r ), leads to the v-transformation defined 
by 




£<-0 GST 1 


^n-\-j — 1 ^n+j 

a n -\-j a n -\-j ~\-1 


1 n+j 


i=o 


£‘-‘KJ) (£i) 


n +j 


. fe-i 


^n+j —1 0*71+j 

a n -\-j P"/v.+j+i 


(1.6.16) 


with the corresponding operators 


<*(A) = {Ffc n }, ^d(A) = {Kl}. 


The transformation discussed in this section are very useful in quadrature, especially 
in accelerating the sequences of computed values to ensure better convergence. 

1.6.7. D- and W- Transformat ions. (Sidi 1987, pp. 349-351) The 19- 
transformation was analyzed by Sidi (1979) for its convergence properties using 
Richardson’s extrapolation process. Two modifications of the 79-transformations 
were proposed by Sidi (1980); they are known as D- and ^-transformations. They are 
useful in simplifying the computation of oscillatory infinite integrals, with emphasis 
on the Fourier and Hankel transforms where the integrands involve a sine or a cosine, 
or a combination of both, of the integration variable (see Sidi 1980b). Levin and Sidi 
(1981) proposed a nonlinear extrapolation method for accelerating the convergence 
of infinite integrals of the form 7£°(/), a > 0. Another modification, known as the 
W- transformation, is available in Sidi (1982) and is very useful in dealing with ‘very 
oscillatory’ infinite integrals (see Chapter 4), a modification of this W -transformation 
is found in Sidi (1987, 1988) and this is useful in dealing with divergent infinite 
integrals, with detailed convergence analysis. The value of these modifications of 
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the ^-transformation lies in their ability to achieve a prescribed accuracy level with 
considerably less computation. 

We assume that the integral I%° — f* = has a well-defined asymptotic 

expansion as x —> oo. Thus, as shown by examples in Levin and Sidi (1981), a very 
large family of functions f(t) that are not singular at infinity, possess asymptotic 
expansions of the form 

pOO pX p oo 

/ / (t) dt — / f(t)dt= / f(t)dt 

J a J a J x 

m —1 oo 

~ ^ x pk f^ k \x) as x —> oo, 

k=0 i=0 (1.6.17) 

where pk < k +1 are some integers that depend on f(x), and fiki are coefficients that 
are independent of x. Once it is established that an asymptotic expansion of the type 

(1.6.17) exists, the integral £°(/) can be determined by using the ^-transformation 

as follows: Choose a sequence of nodes a < x o < x\ < ..., such that lim Xi = oo; 

2—^00 

then compute the finite integrals /*' f(t)dt,i = 0,1,2 ,..., by using the appropriate 
quadrature formula. For given nonnegative integers j and rik, k = 0,1,... , m — 1, 
define the approximation D^ 71 ^, where N = (no, ni,... , n m _i), as the solution 
of the system of linear equations 

/ x p rn-1 n k 

m dt=J2 x p f (k) (* P ) E ^ x pJ<P< j + n, 
k=0 i=0 

(1.6.18) 

m—1 

where N = ^2 (nk + 1), and fiki are the remaining TV unknowns. The ZTtransfor- 

fe=0 

mation can be simplified by replacing p/c in (1.6.18) by (k + 1) for 0 < k < m — 1 
(Sidi 1990), and it will not seriously affect the accuracy. The solution of the system 

(1.6.18) for D can be obtained recursively by using the IF-algorithm for m = 1 
(Sidi 1982), and by the -algorithm for m > 1 (see Ford and Sidi 1987; also 
§5.3.3 for Levin’s transformation). 


1.7. Polynomial Splines 

A polynomial spline of degree n is a piecewise polynomial of the same degree with 
continuous (n — l)-th derivatives. A spline of degree n with (TV + 1) knots Xk, 
k = 0,1,... , TV, is of the form 

n N 

E a k X k + E Pk (x- Xk)+ , (1-7.1) 

k =0 k =0 
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where 

( z if z >0, n 

z+ = l , and z+ = 1 only if z > 0 . 

+ \0 ifz< 0 , + 

According to Rice (1983), splines of the form (1.7.1) are not always suitable for 
computation. A spline fits a polynomial to a set of data. A cubic spline fits a “smooth 
curve” to the data points; it is known as a French curve in the drafting jargon. A cubic 
spline in the z-th interval, which lies between the points (xi , yi) and (xi+i , yi+i), has 
the equation 

g%{x) = di (x- x^ 3 + bi (x- Xi) 2 + a (xq - Xi) + d*. (1.7.2) 


We seek a cubic spline function f(x) which is such that g(x) = g (x^ on the interval 
[xi, Xi+ 1 ] for z = 0 , 1 ,... , n — 1 , and satisfies the conditions 

gi (xi) = yu i = 0 , 1 , • • • ,n - 1 , and# n _i (x n ) = y n , 

9 i (xi+i) = g i+ 1 (xi+i) = g i+ i (x i+1 ) for z = 0 , 1 ,... , n - 2 , 

(1.7.3) 

g'i(xi+i) = g'i +1 (ar i+ i) for i = 0 , 1 ,... , n — 2 , 
g'i { x i+\) = g'i +1 {x i+ i) for i = 0 , 1 ,... , n - 2 . 

There are 4 n unknowns {a^, 6 ^, d^} for z = 0,1,... , n — 1. Solving (1.7.2)- 

(1.7.3), we obtain the recurrence relation 


hi -1 Si- 1 + ( 2 /z^_i + 2 /z^) Si + hi S l+1 

= 6{f[xi,x i+1 ] - f[xi-!,Xi] }, (1-7.4) 

where hi = x i+ i - x u Si = g" (x^ for i = 0, 1 , ... , n - 1 , and S n = (x n ). 

Eq (1.7.4) applies to all n — 1 interior points from z = 1 to z = n — 1, thus giving 
n — 1 equations for the n + 1 values of S); the two remaining equations for So and 
S n are obtained from the conditions at the two endpoints of the interval. However, 
these two conditions are arbitrary but they are chosen from the following choices: 

1. Take So = 0 and S n = 0. Thus, the end cubics approach linearity at their 
endpoints. This condition is known as the natural spline and, although it flattens the 
curve too much at the ends, it is used frequently. 

2. Make the slopes at the endpoints assume specific values. If the slopes are 
not precisely known, they might be estimated from the points. For example, if 
f (xq) = A and f (x n ) = B , we use the divided differences and use the relations 


At left endpoint: 2 ho So + hi Si = 6 (/ [xo,xi\ — A ), 

At right endpoint: h n -1 ,S„_i + 2 h n S n = 6 (B - f [x n _i, x n }). 

This seems to be the best choice, provided reasonable estimates of the derivative are 
available. 
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3. Take So = Si, and S n -i = S n , so that the end cubics approach parabolas at 
their endpoints. 

4. Take So as a linear extrapolation from Si and S 2 , and 5 n as a linear extrapo¬ 
lation from S n -1 and 5 n _ 2 . This makes the cubic splines match f(x) exactly when 
f(x) is itself a cubic curve. For this choice we use the following relations: 


At left endpoint: 
At right endpoint: 


Si-So 5 2 — Si „ (fto + fti) Sl -h 0 S 2 

— - => On = - 


h 0 hi 

Sn S n — 1 S n — 1 5 n —2 


hi 


h n —l h n —2 

{hn—2 T ^n—l) 5 n _i h n —i S n —2 


=> 5 n = 


hn — 


n —2 


This choice gives too much curvature in the end intervals. 

The details of these choices are as follows. Eq (1.7.4) which solves for 5^, 
i = 0,1 ,... , n, can be written in matrix form as 


fto 2 (ho + hi) hi 

hi 2 (fti + h 2 ) h 2 

h 2 2 (h 2 + /13) h 3 

hn— 2 2 (h n — 2 T h n —\ 


5o ] 


z' \ 

Si 


f[x 1,X 2 \ - f[x o,a:i] 

s 2 


/ [X2i X3} ~f [x!,X 2 ] 

S 3 

> = 6 < 

f [x 3 ,x 4 ] -f [x 2 ,x 3 ] > 

S„_1 


f [x n -\,x n ] - f [x n -2, X n -\\ 

l S n J 


< > 


Note that in this matrix equation the first and the last rows are missing; they correspond 
to 5o and 5 n . Now, we start with each of the above choices, and write the form of 
the left-side matrix in each case. 

Choice 1. 5 0 = 0 = S n , and 

" 2 (ho + hi ) hi 

hi 2 (hi + /12) ^2 

2 (h 2 + /13) h 3 

hn— 2 2 (h n — 2 T /l n _i) _ 
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Choice 2. f (c 0 ) = A and f (x n ) = B , and 

~2ho hi 

h ^ 2 (ho + fti) fti 

fti 2 (fti + h 2 ) ft 2 

hn—2 2h n —i _ 

Choice 3. So = Si, S n = S n -i, and 


(3fto + 2fti) 

hi 


hi 

2 (fti + / 12 ) 

h 2 


h 2 

2 ( ft -2 + ft 3 ) 


hn—2 (2ftn—2 4" 3ft n —l) J 

Choice 4. So and S n are linear extrapolations, and 
hi-hi 


Ho 


hi 


hi 2 (fti + h 2 ) h 2 

h 2 2 (ft 2 + ft 3 ) ft 3 


/? 2 — h 2 

'^n—2 n n -1 
ftn-2 


Hn 


where 


(ft 0 + ftl)(fto+2fti) (ftn-l + ftn- 2 ) (ftn-1 + 2h n - 2 ) 

AR) — ---, 44 /7 — ---. 

All Rn-2 

After computing the values of S*, the coefficients in (1.7.4) are given by 

$i+l 7 £/i+l Vi ‘ZhiSi hi Si -)-i £ r \ 

“• = “6ft—- 6> = 7’ '• = —5-6-’ * = * = /fe) ■ 

(1.7.5) 

If f(pc) is periodic and the data cover one full period, then a choice is to take So = S n 
and equal slopes at the two endpoints. 

Example 1.7.1. Consider a data 


d = {/(0,/(l),/(1.7),/(2.6)} = {2, 4.43656, 8.05789, 20.16747}. 

Use cubic splines to compute /(0.76) and /(1.35). Here, fto = 1, fti = 0.7, and 
h 2 = 0.8; the divided differences are /[0,1] = 2.43656, /[ 1,1.7] = 5.17333, 
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/[ 1.7, 2.6] = 13.4551. For a natural cubic spline, we use the end condition 1 with 
Sq = 0 = 53 , and solve 


2 (/iq + h \) hi 

h\ 2 ( h\ + / 12 ) 



/[0,1]-/[1,1.7] 
/[1.7,2.6] — /[l, 1.7] 


}■ 


which becomes 


3.4 0.7] f Si 1 _ f 16.4206 1 
0.7 3.2 J \ S 2 J “ \ 49.6906] J ’ 


and yields Si = 1.70958 and S 2 = 15.1543. The values of a*, b ,. c, and di are 


a* = {0.28493, 3.20112, -2.80635}, h = {0, 0.85479, 7.67715}, 
Ci = {2.15613, 3.00643, 8.9088}, = {2, 4.435556, 8.05789}. 


Thus, g%(x), defined by (1.7.2), approximates fix). Using the above values we find 
that /(0.76) « g 1 (0.76) = 3.76032, and /(1.35) « s 2 (l-35) = 5.73077. The exact 
function is fix) = 2e x — x 2 , which gives the exact values as fix) = 3.69895 and 
/(1.35) = 5.89235. - 
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Interpolatory Quadrature 


We start with the basic concepts of Riemann integration and present numerical method 
for evaluating certain integrals by replacing the integrands by approximating func¬ 
tions, develop the method of the Riemann sums, and discuss interpolatory quadrature 
rules for computing the definite integral /^(/) = f(x)dx. We discuss inter¬ 
polatory quadrature formulas in their basic and repeated (extended or compound) 
forms, and some of the extensions which are known as the Romberg’s and Gregory’s 
schemes. We also present quadrature rules which use nodes outside the interval of in¬ 
tegration. The error bounds for all quadrature rules are presented, and some iterative 
and adaptive schemes are analyzed. 


2.1. Riemann Integration 

Riemann integrals of a function f(x) e (7[a, b] on an interval [a, b], denoted by 


I a(f) = [ f(x)dx, 

J a 


( 2 . 1 . 1 ) 


are defined in terms of the Riemann sum as follows. Let V = {x$, x \,..., x n } be 
any partition of [a, b\. For each k , where 1 < k < n, let be an arbitrary point 
in [xk-i,Xk], and let Axj~ = \x^ — x^-i \ denote the length of each subinterval for 
k = 1,2,... , n. Then the sum 


Rnf = J2f(^) Ax fc , (2.1.2) 

k =1 


44 
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is called the Riemann sum for / on [a, b\. Let \\V\\ denote the norm of the partition 
V\ i.e., it is the largest of the lengths of the subintervals associated with V. Then 

n 

lim £ f (^) AXk = J a(/)‘ R 1 - 3 ) 

k =1 

This convergence of the Riemann sum to I^if) can also be defined as follows: For 
any £ > 0 there is a number 6 > 0 such that if each of the subintervals [xk-i,Xk\ has 
length less than 6 and if Xk-i < 6c < xj~ for 1 < k < n, then 

n 

G/)-£/(&) A» fe <£. (2.1.4) 

k=l 

The indefinite integration is defined in terms of the relation between the antideriva¬ 
tives and integrals, and the notation traditionally used for an antiderivative of / is 
f f(x) dx, which is called an indefinite integral. Thus, 

J f(x)dx = F(x) means F'(x)=f(x). (2.1.5) 

In general, this definition is generalized to 

f(x) dx = F(x) + C is equivalent to -^~{F(x) + C} = f(x), (2.1.6) 

where C is an arbitrary constant, known as the constant of integration. Thus, 
the indefinite integral f f(x)dx implies either a particular antiderivative of / or 
an entire family of antiderivatives, one for each value of the constant C. Care is 
needed to distinguish between definite and indefinite integrals. A definite integral 
Ia(f) = fa f ( x ) dx is a number, whereas an indefinite integral f f ( x ) dx is a function 
of x. 

Tables of indefinite integrals are sometimes very useful when we run into an 
indefinite integral which is difficult to evaluate by hand and we do not have access 
to computer algebra systems, like Mathematica, and others. An extensive table of 
formulas for indefinite and definite integrals is provided on the enclosed CD-R, §8, 
titled ‘Integration Formulas.’ 

2.1.1. Approximate Integration. There are different methods for com¬ 
puting approximate solutions of definite integrals 7^(/). Most of these methods 
are derived from interpolating polynomials and orthogonal polynomials and will be 
discussed in following sections. We use three methods to approximate the definite 
integrals /£(/). 

Method 1: Riemann Sums. We will use formula (2.1.2) by considering then 
subintervals of [a, b] which are of equal length. Then x\~ = a + kh , k = 0,1,... , n, 


© 2005 by Chapman & Hall/CRC Press 



46 


2. INTERPOLATORY QUADRATURE 


where h = (b — a)/n is known as the step size. We choose the point as the 
left or right endpoint of the subinterval [xk-i,Xk\- If 6c = x k -u then we have 

n 

R hf = h ^f( x k-\)\ or, if Cfc = x k , we have R r n f = hf(x k ), where the 

k =1 

superscript l or r designates the left or right endpoint of the interval [xk-i,Xk\ 
chosen. It is easy to show that each R l n f and W n f converges to I^if) as n —» oo 
for any Riemann-integrable function /. If / G (7[a, b], then the (discretization) error 
bound is given by 

\l b a (f)-R n f\ <(b-a)u(f;h), (2.1.7) 

where h ) is the modulus of continuity of /. 

Example 2.1.1. Consider the following integrands: (i) fi(x) = x 2 , (ii) 
f 2 (x) = sin 7 tx, and (iii) fs(x) = ea °h with the interval of integration [0,1]. 
The results of the approximate values of Iq (ft) (x), i = 1, 2, 3, are presented in Table 
2.1.1. It is obvious that the convergence of this method is extremely slow. ■ 

Table 2.1.1 


n 

Rnh 

Rnf2 

Rnh 

4 

0.468750000 

0.6035 53390 

0.7682 83046 

16 

0.3652 34375 

0.6345 73149 

0.6948 31196 

64 

0.341186523 

0.6364 91935 

0.6740 83211 

256 

0.3352 89001 

0.636611786 

0.6685 69673 

1024 

0.3338 21773 

0.636619273 

0.667148643 

4096 

0.3334 55413 

0.636619741 

0.666787946 

Exact 

0.3333 33333 

0.636619772 

0.6666 66666 


Method 2: Approximating Functions. In some cases we can use an 
approximating function to compute an approximate solution for I b a (/). Let a function 
g approximate / on [a, b\ such that \\g — f\\oo < s/(b — a), where £ > 0 is arbitrary. 
Then the error bound is 


1 (f ) - J aDII = [ f(x)dx- f g(x)dx 

J a J a 

[ \f(x)-g(x)\dx<(b-a)\\f-g\\ 
J a 


< £. 


( 2 . 1 . 8 ) 


Example 2.1.2. Compute yjxT(x + 1 )dx by using the approximation 

(Abramowitz and Stegun 1968, p. 257) 


r(* + 1) = 1 + bk x k + Es(x), |£? 8 (*)| < 3 x 10" 7 , 

k =1 
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where 


bi = -0.577191652, 
b 2 = 0.98820 5891, 
b 3 = -0.89705 6937, 
b 4 = 0.91820 6857, 


b 5 = -0.756704078, 
b 6 = 0.48219 9394, 

b 7 = -0.19352 7818, 
b s = 0.03586 8343. 


The computed value is I = 0.614620138422, which compares well with the Mathe- 
matica value of 0.6145201406413421. ■ 

Method 3: Taylor Series Method. Consider the function/ e C°°[—1,1]. 
If both x, a G [—1,1], the Taylor series expansion at x = a is 

f(x) = f(a)+(x-a)f'(a)+■ ■ -+ ^ f (n ~ 1 \a)+j ^ f {n \t) dt. 

Without loss of generality, we take a = 0. Then 

/!,(/) = 2/(0) + | /"(0) + • • • + / ( ”- x) (0) + /(£?„/), 

n n t///q\ ™ ^ 

Qn(f) = f {0)^2+f (0)^2 AiXi H —— ^2 Ai X 1 4 

j=l i=l ' i=l 

^(n—1 )/q\ n 

+ “7- -.x, 1 +Qn(-^n/), (2.1.9) 

T T- i=1 

where £„/ = f — — t J~— f {n) {t)dt. Neglecting I(E n f) and Q n (E„f), and 
Jo \ n — i J ! 

comparing the corresponding terms in and Q n (/), we obtain from (2.1.9) 


E^ 


1 -(-!)" 
k + 1 


k = 0,1,... , n — 1. 


( 2 . 1 . 10 ) 


Eq (2.1.10), known as the momentum equations , represents a linear system in the 
n unknown weights Ai. Using the Vandermonde matrix 


- 1 

1 

1 " 

Xi 


x n 

xl 

^2 

x 2 

J, n 

_n— 1 

_n— 1 

fl — 1 


x 2 

x n J 


we find that for distinct nodes Xi 

n k— 1 

det (A) = P[ P[ (x k - Xj) ^ 0. 

k =2 j =1 


( 2 . 1 . 11 ) 


( 2 . 1 . 12 ) 
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It is not necessary that all Xi be in [—1,1]. Formula (2.1.12) is also valid for nodes 
Xi that are outside the interval [—1,1] provided the Taylor expansion is valid there. 
The first equation in (2.1.11) is 


n pi n 

' s ^A i = 2 for w(x) ^ 1, where / w(x) dx = Ai. (2.1.13) 

2=1 ’’- 1 2=1 

It means that the sum of the weights is equal to the area of the domain of integration. 

Example 2.1.3. The weights of Qsf = A 1 /(—1) + A 2 /( 0) + A s /(1) are 
determined by solving the equations (2.1.11), which are A + 1 + A 2 + As = 2, 
— A\ + 2L 3 = 0, and A 1 + 2L 3 = 2/3, which are solved to give 21 1 = As = 1/3 and 
t 4 2 = 4/3. Hence, 


Qsf — - [/(—1) + 4/(0) + f(l)} , 

which is the Simpson’s rule,* discussed in §2.5. ■ 

If instead of the fixed nodes Xi which are preassigned numbers or vectors we 
treat the nodes as n additional unknown quantities, we end up with a system of 2 n 
equations in 2 n unknowns Xi and Ai, i = 1, 2,... , n, which is known as the enlarged 
system of momentum equations defined by 

n 

Ai x\ = I (x k ) , k = 0,1,... , 2n — 1. (2.1.14) 

2 = 1 

This system is nonlinear and is obtained from the Taylor series expansion for / £ 
C 2 n [— 1,1]. Let us denote I ( x k ) = c&. We will solve the system (2.1.14) by 
eliminating the linear unknowns A^. The following method illustrates it for n = 
3 (thus, 2n — 1 = 5), and its generalization to an arbitrary finite value of n is 
straightforward. First, we use the Gauss elimination method to solve the system: 


A\ + A 2 + A% — Co, 

Ai X\ + A 2 X 2 + A3 X3 = Ci, 


A 1 xf + ^2^2 + ^3 ^3 = C 5 . 


Also, for k = 0,1,2, 


Cfc 2 : 10 : 2^3 - Cfc+1 ( 0 : 10:2 + 2;ia: 3 + 2:22:3) + c fc+2 (2:1 + 2:2 + 2:3) - c fc+3 = 0, 


*This is also known as Kepler’s barrel rule since it was used to evaluate the volume of 
a barrel by rotating its defining contour. 
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This yields the Vieta coefficients 

Vi = X! + X 2 + x 3 , V 2 = X ^ 2 + X\X 3 + ^2^3, V3 = X 1 X 2 X 3 , 


the nodal polynomial 

CJ 3 (x) = (x - Xi) (x - x 2 ) (x - x 3 ) = x 3 - V1X 2 + E 2 £ - ^3, 


and the weights 


A! 


c 0 x 2 x 3 - Cl (x 2 + X 3 ) + C 2 _ CqXiX 3 - Cl (xi + x 3 ) + c 2 

(x 2 - Xi) (x 3 - Xi) ’ (xi - x 2 ) (x 3 - x 2 ) 


a 3 


C 0 x 1 x 2 - Cl (x 1 + x 2 ) + c 2 
(xi - x 3 ) (x 2 - x 3 ) 


(2.1.15) 

Example 2.1.4. This example computes the nodes and the weights of a three- 
point quadrature formula with w(x) = 1. For the integral //*(/) we determine the 
weights Ai and the nodes Xi in Q 3 f. We have Co = 2, c 2 = 2/3, C 4 = 2/5, and 
ci = c 3 = C 5 = 0. The Vieta coefficients are V\ = V 3 = 0, and V 2 = —3/5, thus, 
lo 3 (x) = x 3 — (3/5)x, and its zeros are x\ = —^3/5, x 2 = 0, x 3 = ^3/5. Hence, 
the weights are A 1 = A 3 = 5/9, A 2 = 8/9. ■ 


2.2. Euler-Maclaurin Expansion 

Three important formulas are presented in this section. They are: Darboux’s formula, 
Bernoulli numbers and Bernoulli polynomials, and the Euler-Maclaurin formula. 

2.2.1. Darboux’s Formula. Let f(x) be analytic at all points of the interval 
[a,x], and let (j>(t) E V n . If t G [0,1], we have by differentiation 

7 n 

- - a) m 0 (n_m) (4 / (m) (a + t(x - a)) 

mn =1 

= —(x — a) (£) /' (a + t(x — a)) 

+ (—l) n (x — a) n+1 0(t) /( n+1 ) (a + t(x — a)). 

Since ( t) = (0) = const, we integrate from 0 to 1 with respect to t and 

obtain 

AAo) [/(*) -/(«)] 

n 

= Y (-l) m_1 (a; - ffl) ro {^ n - ro )(l) / (ro )(a;) - <A“ m) (0) / (m) (0)} 

m=1 

+ (—l) n (a; - a) n+1 [' <j>{t) f (n+1) (a + t{x - a)) dt, 

( 2 . 2 . 1 ) 
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which is known as Darboux’s formula. Taylor’s series is a particular case of (2.2.1) 
by setting f(t) = (t — l) n and letting n —» oo. 

2.2.2. Bernoulli Numbers and Bernoulli Polynomials. The function 

z z 

- cot - is analytic for |z| < 2 ir , and being an even function of 2 ; it can be expanded 
into a Maclaurin series 


z 

2 


a ^2 .4 

COt 2 = 1 - 2! - 4! 



( 2 . 2 . 2 ) 


where B n is known as the n-th Bernoulli number. Some values are B\ = 1/6, 
B 2 = 1/30, B 3 = 1/42, B 4 = 1/30, B$ = 5/66, .... These numbers can be 
expressed as definite integrals by 


B n = An 



t 2n-l 
e 27 Tt - 1 


dt. 


(2.2.3) 


t n 

The Bernoulli polynomials B n (x) of order n are defined as the coefficients of — in 

n\ 

e xt - 1 

the Maclaurin expansion of the function t — -, so that 

e l — 1 


f e xt -l B n {x)t n 

e t — 1 ■A n \ 

n =1 

Some properties of this polynomial are: 

1. Set x T 1 in place of x in (2.2.4) and subtract; this gives 


^ f n 

te xt = ^ { B n(x + 1) - B n (x)} —. 

n =1 


(2.2.4) 


By equating the coefficients of t n on both sides of this equation, we obtain 

nx n ~ x = B n {x + 1) — B n (x), (2.2.5) 


which is a difference equation satisfied by B n (x). 

2. An explicit expression for the Bernoulli polynomials is 

B n (x) =x n -±nx n - 1 + (l)B 1 x n ~ 2 -( , l)B 2 x n - 4 +(2)B 3 z n - 6 --- , (2.2.6) 

the last term of which is in a; or a; 2 . In particular, if x is an integer, then we find from 

(2.2.5) that = i«-i + 2" _1 + ••• + (*- l) n ~\ 

n 

2.2.3. Euler-Maclaurin Expansion Formula. If we write B n (t) for <f(t) 
in Darboux’s formula (2.2.1), and differentiate (n — k) times the equation (2.2.5), 
where x is replaced by t, then we get 

B ( n~ k) (t + 1 ) - B^~ k) (t) =n(n-l)...kt k ~ 1 . 
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Set t = 0 in this equation, which gives B i n k \l) = B i n ^(0). Now, from the 
Maclaurin series for B n (x), we have for k > 0 

B (n-2fc- 1 )( 0 ) = o, B^- 2k \ 0) = (-1)"- 1 ^ B k , 

^- 1} (0) = -^!, BiT\0)=n\. 

Substituting these values of B^~ k \ 1) and B^~ k \ 0) into (2.2.1), we obtain the 
Euler-Maclaurin sum formula 


{x - a)f'(a) = f(x) - f(a) - {f(x) - f(a)} 

+ g izl r-^ e{/ , 2m , w _ / , M(a)} (22 7) 

m =1 ' ' 

~ ^ - J B 2 n (t) f {2n+1) (a + t(x-a)) dt. 

In certain cases the last term tends to zero as n —» oo, which gives an infinite series 
for f{x) — f (a). If we set ft for x — a and F(x) for f'(x) in formula (2.2.7), we get 

r a + h ft 

/ F(x)dx = ~{F(a)+F(a + h)} 

m =1 ' ' 

h^n+l r 1 

— (2np Jo B2n ^ F(2n){ - a + th ) dL 

Then writing a + ft, a + 2ft,... , a + (r — l)ft for a in this result and adding all of 
them, we obtain 

/ a+r/i r ^ 

F(x) dx = h F (a + kh) 
k =o 

n ~ 1 /_i \m 77 i2m 

+ E /o v -{^ (2m “ 1} )(a + rh) - f^-Ha)} + Rn, 

{2m). ( 2 . 2 . 8 ) 


where 


m=1 


= 


/l 2n+1 


f B 2 n (t) j X A 2 ”) (a + mh + th ) ) dt. 

Jo L m=0 J 
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Formula (2.2.8) is very useful in numerically evaluating definite integrals. It is valid 
if F{pc) is analytic at all points of the interval [a, a + rh\. 


2.3. Interpolatory Quadrature Rules 


Interpolator polynomials are used to develop quadrature formulas for integrating a 
function f(x) over the interval [a, b\. We choose n points (nodes or abscissae) Xk, 
k = 1,2,... , n, in this interval. If the function f(x) is defined over the interval 
[a, b] , then we must choose these n points Xk, k = 1 , 2 ,. . . , n, entirely in the interval 
[a, b\. But if f(x) is defined outside the interval of integration, then all xk need not 
belong to [a, b\. Quadrature formulas which contain some nodes lying outside [a, b] 
are discussed in Garloff et al. (1986). However, for integration of real integrable 
functions all the nodes Xk must belong to the interval of integration. 

2.3.1. General Integration Rules. Let the interpolating polynomial p(x) 
for f(x) be such that 

f(x) = p(x) + r(x), (2.3.1) 

where r(x) is the remainder of the integration, and 


p( x ) = E 


7 t(x) 


■ f(x k ), 


“ (x - x k ) 7r' (x k ) 

7 t(x) = (x — X\) (x — X 2 ) . . . (x — Xk) • 


(2.3.2) 


Then the exact value of the integral of the product w(x)f(x) over the interval [a, b] is 

pb pb pb 

/ w(x)f(x)dx= / w(x) p(x) dx / w(x)r(x)dx. (2.3.3) 

J a J a J a 

The behavior of the remainder r(x) depends on the preciseness of the interpolating 
polynomial p(x). Thus, if r(x) is small throughout the interval [a, b] , then the second 
term in Eq (2.3.3) can be neglected. This situation leads to the approximate equation 


where 


/ b n 

w(x)f(x) dx ~ E Akf(x k ), 

k =1 

7 t(x) 


Ak 


I w(x) 

J a 


dx. 


(2.3.4) 


(2.3.5) 


(x - x k ) 7 r' (x k ) 

Formulas of the type (2.3.4) are called interpolatory quadrature formulas. The 
necessary and sufficient condition for the quadrature formula (2.3.4) to be interpo¬ 
latory is that it be exact for all possible polynomials p(x) of degree at most n — 1. 
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For a proof of formula (2.3.4) see Krylov 1962, p. 80. Once all n nodes Xk are 
specified, formula (2.3.4) is completely defined, because then the coefficients Ak are 
completely evaluated. 

The remainder R(f) of the rule (2.3.4) is defined by 

rb rb 

R(f)= / w(x)f(x)dx= / w(x) tt(x) f (x, ti, ... , Xk) dx. (2.3.6) 

J a J a 

If / G C n [a, b], then R(f) can be represented in the form 

m ti rt n -1 / n ^ \ 

■ w(x)ir(x) f( n) lx + -x k -i) )dt n ...dt 1 dx, 

Jo \ k=0 J 

(2.3.7) 

where x = xq (see Krylov 1962, p. 81). But if we use the Lagrangian form of r(x), 
which is 

r ( x ) = ~\_ 7r ( x ) f in) (A a < £ < b, 

then 

R(f) = -7 [ w(x)n(x) f in) (£)dx. (2.3.8) 

This expression for R(f) does not yield an exact bound for R(f) because we cannot 
determine how £ depends on x. But if \f^ n \x)\ < M n for all x G [a, b\, then from 

(2.3.8) we get 

M f b 

\R(f)\ < —p / KT)^(T)|dT. (2.3.9) 

If the product rc(x) tt(x) does not change sign on the interval [a, b], then the bound 

(2.3.9) cannot be improved. However, for arbitrary w(x) and an arbitrary sequence 
of n nodes x^we have 


R(f) 


f b K(t)f 

J a 


\t) dt , 


(2.3.10) 


where the kernel K(t) is defined by 


m 


rb / — t 

/ w(x) [U(x — t) — U(a — t)] — -—— dx 

J a \ n — !/• 

- p A k [U (x k -t)- U(a - 1 )] 


(2.3.11) 
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and if t ^ a and t ^ Xk, k = 1,... , n, then 

rt 


K(t) = { 


rt , . (X ~ t) U 1 ™ (X — t) U 1 

-fa w ( x ) (n- 1)! + -TTi ifi<a, 


(n — 1)! 


fa W ( X ) 




n—1 


■dx-J2 Xh>t A 


(x-t) 


n—1 


Xk>t k (n — 1)! 


if t > a. 


(n — 1)! 

Finally, if | ( x ) | < M n for x G [a, 6], then 

\R(f)\<M n f b \K(t)\dt. 

J a 

2.3.2. Lagrange Formula. This formula for the interval [a, b\ is 

n 

J a(/) = E (4 n) (*0 - 4”V)) fk + Rn, 


(2.3.12) 

(2.3.13) 

(2.3.14) 


fc =0 


where 


4 ” )W =<UI 

h (x) = 


ir(t) 


dt = 


f l k (t)dt, 

J Xn 


Xo t x k Jx o 

TT n (x) (X-X 0 )...(X- X k -l) (X ~ X k+1 ) ...(X-X n ) 


(X - X k ) 7T^(x) (X k -X 0 )... (X k ~ X k -l) (x k ~ X k+1 ) ...(X k - X n ) ’ 


Rn = 


- J 7 T n (x) f (n+1) (£(x)) dx., 


(n + 1 )! 

For an equally-spaced quadrature points x\~ this formula becomes 



Kn(x) 

X — Xn 


dx + Rm 


fX m+1 

/ f( x ) 

J Xn 


dx = h 


H 2 ] 

E Ai(m)fi + R n 

i=-[(n- 1)/2] 


(2.3.15) 

(2.3.16) 


where Ai (m) denote the Lagrangian integration coefficients available in Abramowitz 
and Stegun (1968, p. 915). 


2.4. Newton-Cotes Formulas 

Consider the definite integral l\ (/) = J^ f(x) dx. We partition the interval [a, b] into 
n equal subintervals of length h = (b — a)/n at the points a, a + ft, a + 2ft,... , a + 
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nh = b. We will derive interpolatory quadrature formulas using these points as nodes. 
The values of the coefficients A k in formula (2.3.4) are determined in a form that is 
independent of the interval [a, b\. Thus, we write (2.3.4) as 



dx = (b 


— a) 


Y,C%f(a + kh), 

k =0 


(2.4.1) 


which is known as the Newton-Cotes formula, where the coefficients Cf: are given 
by 


C% = A k /(b - a) = -T- [ b -4UL- — dx, 

b — a J a {x — a — kh) 7r'(a + kh) 

7r(x) = (x — a)(x — a — h)(x — a — 2 h )... (x — a — nh). 


(2.4.2) 


If we set x = a + th , then 


x — a — kh = h(t — fc), 

7 t(x) = h n+1 t{t — 1 )(t — 2)... (t — n), 
7r'(a + kh) = (-1 ) n ~ k h n k\ {n - k)\. 


Then 

/_i \n—k pn 

c k = nfc! ( n _ fc )! J o t(t-l)(t-2)...(t-k+l)(t-k-l)...(t-n)dt. (2.4.3) 

The coefficients are known as the Cotesian numbers. Some of these numbers are 
tabulated in Table A.l for k < n/2, since C% = C™_ k . A table of Cotesian numbers 
for n = 1(1)20 is available as the file CotesianNumbers.pdf on the CD-R; also, 
see Kopal (1961) and Johnson (1915) where a short history of the Cotesian numbers 
is also given. 

In order to understand the behavior of the Newton-Cotes formula (2.4.1) for a 
large number of nodes, we will derive the asymptotic representation for C k for large 
n. First, we write the integral in (2.1.8) as 

r f n x(x — 1 ).. Ax — n) 1 

I = / - L —^- L dx. (2.4.4) 

Jo x — k 


Since x[x — 1)... {x — n) 


T(x-bl) 1 

T{x-nY aM f(^) 


T(1 — x) sin 7 tx 

-, we get 

7r 


x(x — 1)... (x — n) 


(-i) n 

7r 


T(x + l)T(n + 1 


x) sin 7rx, 
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and thus, 


i = (-iy 


= (-U 


T(x + l)r(n + 1 — x) sin 7 vx 


■ (x — k) 


3 pn —3 pn 


0 J 3 J n —3 


T(x + l)T(n + 1 — x) sin 7 rx 

7T (x — k) 


h + h + h-> 


XT • H*) 1 ^ A/l 1 \. . . , . 

Now, since ^ ^ =-G + ^ ( p — ~kA~. ) 1S a monotone increasing function 


k k + z 


for z > 0, we notice that by using Taylor’s formula the derivative of the function 
T'(z) 

y is of the order 1/z for large z. Thus, 

1 (z) 


In r(n + 1 - *) - In T(n + 1) - + O Q. 


T'(z) / 1 \ 

Then since for large 2 : using the approximation . = In 2 ; + O ( - ), we find that 

r(z) \zJ 

T(n + 1 — x) = T(n + 1) e ~ xlnn 1 + 0^—^ . Also, for 0 < x < 3, 


w . sm irx x \ 

r(a + 1) ^(^ = -fc +0 (T)> 


xe~ x[nn dx = 


1 1 r 3 1 


x 2 e~ xlnn dx 


In n n 3 Inn In 


2 1 f 9 6 2 


ln 3 n ti 3 I In n In 2 n In 3 n 


which gives 


lxi r x x 


h= / r(n + l)e~ xlnn 1 + 0 - -T+O —) dx 


n) k 


T(n + 1) 
k In 2 n 


1 + O (—*—) for 1 < k < n — 1. 

Vmn/ 


(2.4.6) 


Similarly, 


h = (- 1 ) 


„_i_T(n+l)_ 1 + 0 /J_\ for 1 < /c < n — 1. (2.4.7) 


(n — fc) In n 
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Now, for the integral I 2 note that 

T\x + 2) r'(n + l-a:)f <0 for-1 < x < n/2, 

T(x + 1) T(n + 1 — x) \ > 0 for n/2 < x < n + 1. 


This implies that for 3 < x < n — 3 the quantities lnT(x + 1 )T(n + 1 — x) and 
T(x + l)T(n + 1 — x) will have their largest value at the endpoints of this interval, 
i.e., 

0 < T(x + l)T(n + 1 — x) < T(4)T(n — 2) = 6T(n — 2). 


Since 


sin 7 tx 
7 t (x — k) 


< 1, we have 


I/ 2 I < 6nT(n — 2) 


6T(n + l) _ /T(n +1) 
(n — 2 )(n — 1) V n 2 


Thus, combining (2.4.6), (2.4.7), and (2.4.8), we find that 


(2.4.8) 


(—l) n ~ 1 r(n + 1) 

In 2 n 


1 

k 


(-1 ) n 
n — k 



(2.4.9) 


This yields the following asymptotic representation for the Cotesian numbers for 
1 < k < n — 1: 


B 


n 

k 


(-1) 


fe_1 n! 


k\ (n — k) \ n hr n 


(-1 r 

n — k 



Note that 


/■m _ s^in _ 

G ° “ “ ThN 


o 


Inn 


(2.4.10) 


(2.4.11) 


From the expressions (2.4.10) and (2.4.11) it is obvious that the Newton-Cotes formu¬ 
las will have both positive and negative coefficients which in absolute value exceed 
any arbitrary large number. Thus, for large n, a small discrepancy in the values of 
the function f(a + kh) can generate a larger error in the quadrature sum. It is for 
this reason that the Newton-Cotes formulas with larger number of nodes are not very 
useful in practice. Now, we consider the following two cases. 

Case 1. When n is an even number, the Newton-Cotes formulas will have an odd 
number of nodes. In this case the function tt(x) is such that 7r(a+£) = —7r (a+nh—z), 
where 2 : < b — a, and the graph of 7 r(x) will be symmetric with respect to the midpoint 
(a + b)/2 of the interval [a, b\. If / G C n+2 [a, b], then the remainder R(f) can be 
expressed as 

f(n+2)(f\ rb 

R(f) = ( n + 2 )j J x n{x)dx, a < £ < b, ( 2 . 4 . 12 ) 


2005 by Chapman & Hall/CRC Press 



58 


2. INTERPOLATORY QUADRATURE 


and the coefficient of /( n + 2 ) (£) is negative. This result implies that if the number of 
nodes in formula (2.4.1) is odd, then the algebraic degree of precision in this formula 
is n + 1. Thus, from (2.4.12) which represents error, formula (2.4.1) will be exact 
whenever f(x) is a polynomial of degree < n + 1. If f(x) is a polynomial of degree 
n + 2, then /( n+2 )(x) will be nonzero and R(f) ^ 0. The error R(f) can also be 
expressed in terms of the kernel K(t) as 


R(f) 


f f {n+2 \t)K(t)dt, 

J a 


(2.4.13) 


where K(t) < 0 on [a, b] and is given by 


m 


(I b - t) n+2 
(n + 2)! 


n 

^ AkU(a + kh — t ) 

k =1 


(a + kh — t) n+1 
(n + 1)! 


(2.4.14) 


Case 2 . When n is an odd number, there are an even number of nodes in formula 
(2.4.1). The polynomial tt(x) takes the same value at both the points a + t and b — t, 
where t < b — a. It means that the graph of i t(x) will be symmetric with respect to 
the line x = (a + b)/2. If / £ C n+1 [a, b], then the remainder R(f) can be expressed 
as 


R(f) 


/ (n+1 Y) 

(n + 1)! 



a < £ <b, 


(2.4.15) 


and the coefficient of /( n+1 ) (£) is negative. As in the above case, this result implies 
that if the Newton-Cotes formula (2.4.1) has an even number of nodes, then its 
algebraic degree of precision is n + 1. The error R(f) can also be expressed in terms 
of the kernel K(t) as 


R(f) 


f f {n+1 \t)K(t)dt, 

J a 


(2.4.16) 


where K(t) < 0 on [a, b] and is given by 


K(t) 


(b - t ) n+1 
('n + 1 )! 


n 

J2 A kU(a + kh-t) 

k= 1 


{a + kh — t) n 

n\ 


(2.4.17) 


2.4.1. Closed-Type Newton-Cotes Rules. We write the rule (2.4.1) as 

n 

J a(f) = {b-a)J2 w kf Uc), 

k =0 


where J2k=o w k = 1- The weights Wk forn = 1,2,... , 11 are given in Table A.l. 
For n = 1 this formula gives the basic rectangle rule; forn = 2 it gives Simpson’s 
two-strip rule, and for n = 3,... , 10 it gives the following rules: 
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1. Simpson’s 3/8 Rule. 


/ 


f(\ r l _ 3 /l ( f I Of iQf _l_f\ 3 ft 5 / ( 4 ) (C) 

f(x) dx — — (/o + 3/i + 3/2 + / 3 ) — 


80 


2. Bode’s (Four-Strip) Rule. 

2 h 
45 


z^ 4 9 h 

/ f( x ) = — (7/o + 32/i + 12/2 + 32/3 + 7 / 4 ) 

J xo ^ 

8 h 7 / (6) (£) 


945 


3. Five-Strip Rule. 


r x $ 

J f ( x ) = (19/o + 75/1 + 50/2 + 50/3 + 75/4 + 19/5) 

275 ft. 7 / (6) (£) 


12096 


4. Six-Strip Rule. 


F 


f(x) dx — — (41/o + 216/i + 27/2 + 272/3 + 27/4 


216/b + 41/e) - 


9fe 9 / (8 H0 

1400 ' 


5. Seven-Strip Rule. 


L 


X 7 Yh 

fix) dx = (751/o + 3577A + 1323/ 2 


2989/3 + 2989/4 + 1323/ 5 + 3577/ 6 + 751/ 7 ) 
8183 /i 9 / (8) (£) 


518400 

6. Eight-Strip Rule. 

/•** 4L 

J fix) dx = (989/o + 5888/! - 928/ 2 + 10496/ 3 


- 4540/4 + 10496/5 - 928 f 6 + 5888/7 + 989/8) 
2368/i n / (10) (£) 


467775 


7. Nine-Strip Rule. 


r x Q q h 

J f(x) dx = [2857 (/o + / 9 ) + 15741 (/1 + / 8 ) 


1080 if 2 + / 7 ) + 19344 if 3 + fo) + 5778 if 4 + /s) ] 
173 h 11 f (10) iO 


14620 
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8. Ten-Strip Rule. 


pxio ^ 

j f(x) dx = 2QQ376 [16067 (/o + ho) + 106300 (/i + / 9 ) 

- 48525 (/ 2 + h) + 272400 (/ 3 + f 7 ) - 260550 (/ 4 + / 6 ) 


+ 427368 / 5 ] 


1346350/i 13 / (12) (£) 

326918592 


A simple guideline to use the Newton-Cotes rule is as follows: When n is even (i.e., 
when there is an even number of subintervals or an odd number of base points), this 
rule is exact when f(x) is a polynomial of degree n + 1 or less; when n is odd, this 
rule is exact for polynomials of degree n or less; conversely, a polynomial of degree 
n is integrated exactly by choosing n + 1 base points. 

Smith (1965) gives two compound N-C rules on the interval [—1,1], which are 
1. 7-8 Rule: 



■ n—l n 

7 ^2 9 (kir/n) + 8^2g(k- 1/2)tt jn) 


k =1 


k =1 


7r 


2 


60n 2 


[/(-l) + /(l)] + 0(n- 6 ); 


2. 31-32 Rule: 



n—1 n 

31 g (kir/n) + 32 g (k — l/2)ir/n) 

k= 1 fc=l 



945 \2n/ J V 

1 / 7T \ 4 


,2n/ 




315 ©' l/'W-n-D] 


/(!)] 

o (^ _8 ) , 


where g(x) = sin x/( cost). These rules are somewhat similar to the Clenshaw- 
Curtis rules (see §4.3.4). 

The non-repeated trapezoidal and Simpson’s rules are special cases of the closed 
Newton-Cotes formulas (2.4.1), which can be written as 



n 

( x °+• 

i =0 


(2.4.18) 


For example, for n = 3 we have the weights wq = = 3h/S, w\ = = 9h/S. 

For even n these formulas are exact if / is a polynomial of degree n + 1. Note this 
for the Simpson’s rule for n = 2 given above. 

2.4.2. Open-Type Newton-Cotes Rules. These formulas have the form 

rx n n- 1 

/ f(x) dx « ^ Wi f (xo + ih) . (2.4.19) 

J Xo i = Q 
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The terms ‘closed’ and ‘open’ refer to whether the endpoints x$ and x n are included 
or not included in the formula. Using (2.4.19) the simplest N-C rule over the interval 

[xo — h,x o + h\ is 

f(x) dx = 2hfo + h 3 f ^ Q /"(&) ds 
= 2hf 0 + l -h 3 f"{i x ). 

If we apply this rule over the interval [x$, xi], we get 
r Xl / h \ h ^ 

J f{x) dx = hf[x o + 2 ) + 24 U(0> ^0 < C < ^l) (2.4.20) 

which is known as the midpoint rule. The repeated midpoint rule is 


f XN 1 h 2 

/ /(x)dx = ft ^/Lj+ -)+(xat- x 0 W/"(£), x 0 < £ < aftv, 

•'zo i=o 

(2.4.21) 

Some specific formulas are as follows: 

rx 3 ou u3 

1 . J x f(x)dx = 6 -{f 1 + h) + -no- 

2 . j f(x)dx = Y (2/1 -/2 + 2/ 3 ) + ^-/ (4) (6- 

J f( x )dx=— (ll/l + /2 + /3 + H/ 4 ) + / (4) (0* 

fi/? 41 

4- J f{ x )dx = — (ll/i — 14/2 + 26/3 — 14/4 + II/5) + 1^0 / (6) (C 

Z '* 7 7ft 

5. j f(x) dx = — (611/! - 463/ 2 + 562/3 + 562/ 4 - 453/ s + 611/ 6 ) 


5257ft' 


/ (6) (A 


6 . j f(x) dx = — (460A - 954/2 + 2196/a - 2459/ 4 + 2196/ 5 

-954 / 6 + 460/ 7 ) + ^^/( 8 )(C). 

We can obtain some integration formulas of the open type by using only the 
interior nodes either by making a Lagrangian fit at these interior points or by the 
method of undetermined coefficients used in §2.3.1 without using the terms f(a) and 
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f(b). These rules have equally spaced nodes of step size h : 

r 3h 2/7 2/1 3 

/ f( X )dx = — (a+/ 2 ) +—no, 

i/i ^ 5 

J f( x ) dx = — (2/1 - / 2 + 2/3) + / (4) (A 

l f( x ) dx = ^l ( n /i + /2 + h + H/ 4 ) + / (4) (A 

f 6h 2 h AM1 7 

J' f( x ) dx = — (ll/i - 14/2 + 2/3 - 14/4 + H/5) + f {6) (0, 


where fi = f(ih ), and £ is an interior point of the interval of integration. Since these 
rules have alternately plus and minus signs, they will show instabilities, but they 
are useful for integrals with endpoint singularities, thus enabling the computation of 
singular integrals which are discussed in detail in Chapter 5. 


Note that the midpoint rule (2.4.20) requires only one evaluation of/, as compared 
to two in the trapezoidal rule, although (2.4.20) has high accuracy of order h 3 . Also 
the repeated midpoint rule (2.4.21) requires N evaluations of /, which are only 
one less than those required by the repeated trapezoidal rule. It would appear that 
the midpoint rule (2.4.20) is better than the trapezoidal rule, but this observation is 
misleading. In fact, if f" has the same sign in [xo ,xn], the exact value of the integral 
lies between the values computed by the midpoint and the trapezoidal rules. The 
following examples illustrate this remark. 

dx 


Example 2.4.1. Compute 
exact value is 0.69314718. 


/' 


l + x 


. The results are given in Table 2.4.1. The 


Table 2.4.1. 


n 

Trapezoidal 

Midpoint 

Simpson’s 

1 

0.750000 

0.666667 

- 

2 

0.708333 

0.685714 

0.694444 

3 

0.7000 

0.689755 

- 

4 

0.697024 

0.691219 

0.693254 

5 

0.695635 

0.691908 

- 

6 

0.694877 

0.692284 

0.693149 


Example 2.4.2. 


Compute 


/ 


dx 


1 A- x 


2 * 


The results are given in Table 2.4.2. 
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The exact value is tan 1 (1) ~ 0.785398. 

Table 2.4.2. 


n 

Trapezoidal 

Midpoint 

Simpson’s 

1 

0.750000 

0.800000 

- 

2 

0.775000 

0.790588 

0.783333 

3 

0.780769 

0.787712 

- 

4 

0.782794 

0.786700 

0.785392 

5 

0.783732 

0.786231 

- 

6 

0.784241 

0.785977 

0.785398 


Note that (i) Newton-Cotes rules are Riemann sums; thus, if n —> oo, they 
converge to the exact value of the integral; and (ii) Trapezoidal rule T n is sometimes 
modified to Romberg’s scheme (see §3.5 ) or Gregory’s scheme (see §3.6). These 
schemes provide modifications of this rule with an end correction. 

If we rewrite the formula (2.4.1) in the form 



(2.4.22) 


then the weights w m j for some useful quadrature rules are given in Tables A.2, A.3, 
A.4 and A.5 (Baker 1978, p. 120). 


2.5. Basic Quadrature Rules 

A classical quadrature rule has the form 

pb n 

J aU/) = / W ( x )f( x )dx = ^2w k f(x k )+E n , 

Ja k=1 

where w(x) denotes a weight function, Wk are the weights, Xk the nodes or abscissae 
(or quadrature points), n E Z + , and E n the error term. The first basic rule is obtained 
from the left-hand Riemann sum 


n — 1 , 

!a(f) ~ h^2f(a + kh) = R^if), h= -- 

k=0 


and the right-hand Riemann sum 


I b a {f)*hY J f(CL + kh) = R%\f). 

k=1 


2005 by Chapman & Hall/CRC Press 








64 


2. INTERPOLATORY QUADRATURE 


These are known as the rectangular rules. The second basic rule is the midpoint 
rule 

71—1 

I b aU) «/*E/( ffi +UI))= M nU), 

k =0 

and the third basic rule is the average of the two rectangular rules 

n 

Ia(f) ~ ^ I/( a ) + 2f(a + h) + • • • + 2/(a + (n — l)ft) + /(&)] = T n (f), 

k= 1 


which is the well-known trapezoidal rule. The rules M n (f) and T n (f ) are exact for 
linear function f(x). 

The procedure to construct new quadrature rules from the basic rules is simple and 
it is achieved first by fitting the integrand f(x) to a polynomial and then integrating 
this fit analytically to generate a new rule, although care must be taken to avoid 
unwanted circumlocution. For example, if f(x) is fitted by a straight line through the 
endpoints (a, /(a)) and (6, /(&)), we obtain the basic trapezoidal rule 


Ia(f) 


f\r 

J a 


q)dx= [/(a) + f(b)\, 


i — bf(a)—af(b ) t . t1 . 

where m =---and q =---. Thus, the trapezoidal rule is two- 

b — a b — a 

point and has degree 1. Similarly, the basic Simpson’s rule is obtained by fitting f(x) 
to a quadratic at the three points (a,/(a)), (c, /(c)) and 6, /(6)), where c = (a+6)/2: 


J a(/) ~ J ( mx 2 + ga; + r) dr = [/(a) + 4/(c) + /(&)] 

= \ [/(a)+4/(c) + /(6)], 

where h is the step size (distance between the abscissae), and 


= (c - b) f{a) + (q - c) /(&) + (b - a) /(c) 

(c — a) (6 — c)(a — b) 

(b 2 - c 2 ) /(a) + (c 2 - a 2 ) f(b) + (a 2 - fr 2 ) /(c) 

^ (c — a) (6 — c)(a — 6) 

6c(c — b) /(a) + ac(a — c) /(&) + ab(a — b) /(c) 

(c — a)(b — c)(a — b) 

The basic Simpson’s rule is three-point and has degree 3, although we started with 
fitting / by a quadratic. This feature makes Simpson’s rule more accurate and widely 
used. By dividing [a, b] into n subintervals and applying the two-point trapezoidal rule 
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in each subinterval, we obtain the repeated (or extended) trapezoidal rule. Similarly, 
we obtain the compound Simpson’s rule. 

Some quadrature rules use / and its derivatives, such as in Hammer and Wicke 
(1960) and Patterson (1969) rules. These rules are also used widely and provide better 
accuracy in certain cases; the only requirement is that the derivatives of / must exist. 

Another derivation of rules is based on the use of the complete set of monomials 
{1, x ,..., x n } for f{x) for some n, which generate sufficient equations to evaluate 
and fix the sets Wk and x^. Certain other conditions may be imposed on these 
constants, such as the nodes {xk} are equally spaced. This approach yields a general 
class of formulas which are known as Newton-Cotes (N-C) rules where the nodes are 
equally spaced. The trapezoidal and Simpson’s rules, among others, are special cases 
of the N-C rules. 

Example 2.5.1. Using the test functions f\{x) = e~ x ,f<i{x) = cosx, fs{x) = 

\[x, U(x) = 2 > M x ) = i / h( x ) = X 1 / 4 , f 7 (x) = a; 1 / 6 , f 8 (x) = 

1 + x z 1 + e x 

1 2 

- 7 , fg(x) = -, with \a.b] = [0,11 and h = 1/50, the basic rules 

1 + x 4 J v ' 2 + sin IOttx 1 ’ J L ’ J ' 

yield the results presented in Table 2.5.1. For computational details, see ex2.5.1. nb 

on the CD-R. ■ 


Table 2.5.1. 


/ 

p(l) 

E>( 2 ) 

rtn 

M n 

T n 

Simpson’s 

Exact 

fl 

0.63846 

0.62582 

0.6321102 

0.6321416 

0.632120558 

0.632120558 

h 

0.84604 

0.83684 

0.8414850 

0.8414429 

0.841470984 

0.841470984 

h 

0.65609 

0.67609 

0.6668305 

0.6660953 

0.666585482 

0.666666667 

f± 

0.79038 

0.78038 

0.7854064 

0.7853814 

0.785398163 

0.785398163 

fb 

0.38219 

0.37757 

0.3798846 

0.3798872 

0.379885493 

0.379885493 

fs 

0.78759 

0.80759 

0.8003793 

0.7975981 

0.799452252 

0.800000004 

fl 

0.84328 

0.86328 

0.8575615 

0.8575615 

0.856136138 

0.857142857 

fs 

0.87193 

0.86193 

0.8669896 

0.8669396 

0.866972987 

0.866972987 

fa 

1.15469 

1.15469 

1.1547049 

1.1546961 

1.154702007 

1.154700538 


In order to numerically evaluate the definite integral /^(/) = f(x)dx, we 
take the simplest example of a straight line interpolating f {x) at the endpoints of the 
interval. A linear interpolating polynomial is 

p(x) = f(a) + (x-a) ^ , 

and after integration we obtain the basic trapezoidal rule: 

I b a(f) * J\(x) dx = b -TT [/(«) + /( & )]- (2- 5 - 1 ) 

A better approximation is obtained by using an interpolating polynomial of higher 
degree. Thus, a quadratic interpolating polynomial which interpolates f(x) at the 
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points a, —and b is defined by 


p(x) = f(a) + (x-a)f 


a, 


a b~\ 


a b 


+ (x - ^y~) ( x ~ a )f 


CL + b ' 


and yields the basic Simpson’s rule : 


4 b (/)» s(f) = 


b-, 


/(a) + 4 


7(6) 


(2.5.2) 


The basic Simpson’s rule is three-point and has degree 3, although we started with 
fitting / by a quadratic. This feature makes Simpson’s rule more accurate and widely 
used. 


Now, we will further analyze the Simpson’s rule S(f). Let c = —-—, and split 
the integral into two parts: 

I b aU) = [ f(x)dx+ f f(x)dx. 

J a J c 

Applying the integration by parts to each of these integrals, we get 

J a(f) = [f( x ) {x~Cl)] C x=a ~ [ f'(x) (x-d) dx, 

J a 

Jc f(x) dx = [f(x) (x - C 2 )] b x=c - f(x) (x - c 2 ) dx, 

where c\ and c 2 are arbitrary constants of integration. After adding these two expres¬ 
sions we obtain 


J a(f) = f( b ) (b ~ c 2 ) + /(c) (c 2 - ci) + f(a) (d - a) 


I f(x) (x-d) dx - I f'(x) (x - c 2 ) dx. 
J a J c 


To obtain the Simpson’s rule S(f), we choose the values of c\ and C 2 as 

b — a 


b — a 4 (b — a) 

b — °2 = —~—, c 2 - ci =---, 

6 6 

A unique solution of these three equations is 


ci — a = 


6 


ci = 


5 a T b 
~6 ’ 


C2 = 


a T 5 b 
~6 ’ 


Define a function g(pc) by 


f x — ci if a < x < c, 
\ x — c 2 if c < x <b. 
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Then we get 

I a(f)=S(f)-[ f'(x)g(x)dx , 

J a 

provided / e C 1 [a, b\. If \f'(x) \ < M\ for a < x < b, then 

f f(x) dx — S(f) < M\ f \g(x)\dx. 
J a J a 

Moreover, if / G C 4 [a, b], then 

I b a (f ) = S(f)+ f f^(x)k(x)dx, 

J a 


where 


( (x — a) 3 ( a + 2b 
x — 


k(x) = < 


24 

(x - b ) 3 
24 


x — 
b( 


^ if a < x < c, 

\ if c < x < b. 
o / 


3 

2 a -\~ b 


(2.5.3) 


(2.5.4) 


The error in approximating the integral /£(/) by the Simpson’s rule is given by 




t|A>(s), a<(<b - (2 - 5 - 5) 


Note that since k(x) < 0 on [a, b ], we use the mean value theorem for integration and 
write 


[ f {i) {x) k{x) dx = f {i) {£,) f k(x) dx, 
J a J a 


and a simple calculation yields 



(b — a) 5 


2880 


The error bound (2.5.5) 


indicates that it may not be a good idea to apply the basic Simpson’s rule to approxi¬ 
mate the integral (2.5.1), because the length of the interval \b — a\ is raised to the fifth 
power. However, if we can reduce this length, we will reduce the error significantly. 
This is done by partitioning the interval [a, b] into N equal subintervals of length 
h = (b — a)/N, and writing 


N—l (i+l)/i 

7 a(/)=E/ f^ dX - 

i =0 Ja+ih 


Then applying the basic Simpson’s rule to each integral, we obtain the repeated 
Simpson’s rule: 


W)» s N (f) 

N-l , 


= £ 


i=0 


/(a + ih ) + 4 / (a + (i + 1/2)ft) + / (a + (i + 1 )h) 


(2.5.6) 
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Alternatively, we use the Newton-Gregory forward polynomial (1.4.19) to inte¬ 
grate a function f(x) with respect to x over an interval (a, b). Thus, 




(2.5.7) 


The error in this approximation is given by 

E ^ = Ia (n + l) V* + 7 (n+1) (0<fc;> a < £ < b. 


(2.5.8) 


If the interval of integration (a, b ) matches the range of fit of the polynomial, which is 
(xo, T n ), i.e., when a = xq < x\ < X 2 < ... < x n = b, then we obtain the Newton- 
Cotes formulas. These formulas are a set of integration rules which correspond to 
the varying degree of the interpolating polynomial. The first three Newton-Cotes 
formulas, with the degree of the polynomial as 1, 2, and 3, are especially important. 
They are: 


n = 


px 1 pX\ pi 

1 : / f{x) dx& (/o + sAfo) ds = h (f 0 + sAf 0 ) 

J x o J x o «/ 0 

= ^ (/o + /i), where s = (x — xq) /h, dx = h ds , 


n = 


n = 3 


dx 


error = 


f ^) h2f " {0di= L 


(2.5.9a) 


s(s- 1) 


h 2 f"(0 dx 


hr* 

= Y f s(s-l)f"(0ds 
2 • f (fo + sA/o + 

Jxo V 

a 


x 0 

h 3 


= -^/"(€), a?o<£<£i; 


(2.5.9b) 


^r^A 2 /o ) d* 


= h I (fo + sAf 0 + -*-) a 2 / 0 ) ds 


= | (/o+4/!+/ 2 ). 


(2.5.10a) 


error = 


f 


2)(. - 3) 


= -^d/ w (^), x 0 <i<x 2 -, 


(2.5.10b) 

3/, 

/ f{x) dx = — (/ 0 + 3/i + 3/ 2 + / 3 ), (2.5.11a) 

J xq ° 


error = h 5 f v (£), x 0 < £ < x 3 . 


(2.5.11b) 
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Note that the error term for both n = 2 (quadratic) and n = 3 (cubic) cases is O (fi 5 ). 
Thus, the error of integration using a quadratic is the same as using a cubic. Also, the 
coefficient —1/90 in the quadratic case is smaller than the coefficient —3/80 in the 
cubic case, which means that the formula with n = 2 is more accurate than that with 
n = 3. In fact, this phenomenon is true for all even-order Newton-Cotes formulas; 
each has the same order of h in its error term as in the next higher (odd) order formula. 
This suggests that the even-order formulas are more useful for numerical integration. 

The derivation of the class of Newton-Cotes (N-C) rules, where the nodes are 
equally spaced, is based on the use of the complete set of monomials {1, x, . .., x n } 
for f(x) for some n, which generate sufficient equations to evaluate and fix the sets 
Wk and Xk- The trapezoidal and Simpson’s rules, among others, are special cases 
of the N-C rules (see §2.6.3). For implementation of the trapezoidal and Simpson’s 
rules, see trapsimp. f 90, trapsimp .m and trapsimp. nb on the CD-R. 

Example 2.5.2. Using the test functions fi(x) = e~ x ,f 2 (x) = cosx, fs(x) = 
\Jx, = - - x2 , fs(x) = Y~j—with [a, b ] = [0,1] and h = 1/40, the basic 
rules yield the results presented in Table 2.5.2. ■ 

Table 2.5.2. 


/ 

E>(1) 

E>( 2 ) 

JXn 

M n 

T 

Simpson’s 

Exact 

h 

0.6400 

0.6243 

0.632104 

0.63215348 

0.63212056 

0.63212056 


0.8472 

0.8357 

0.841493 

0.84142716 

0.84147099 

0.84147098 

h 

0.6534 

0.6784 

0.666894 

0.66587096 

0.66634576 

0.66666667 

u 

0.7916 

0.7791 

0.785411 

0.78537212 

0.78539816 

0.78539816 

h 

0.3828 

0.3770 

0.379884 

0.37988827 

0.37988549 

0.37988549 


2.6. Repeated Quadrature Rules 

A quadrature rule Q(f) is defined as 


^(/) = 5>fc/(**)+*?(/), (2.6.1) 

k =0 


where are the weights (or coefficients ) and are the quadrature points (or base 
points or nodes). The interval [a, b\ is a finite or infinite interval of integration. The 
error term E(f) =0 iff f(x) is a polynomial of degree <n. Let the interval [a, b] be 
finite and partitioned by n equally spaced points Xk = a + k h, k — 0,1,... , n, where 
h = (b — a)/n. Sometimes we will use the notation: f k = f (x^. The repeated 
quadrature rules are as follows: 
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R n \ Repeated Rectangle Rule: I h a = 


f f(x)dx ss h^f (x k ). 

Jxo u —n 


k =0 
n— 1 


M n : Repeated Midpoint Rule 


: Ia(f) = [ f( x ) dx « h x>(‘ + (fc + l/2)ft). 

^0 U — n 


k =0 
n+1 


T n : Repeated Trapezoidal Rule 


rx n 7 

:I b a (f)= F(s)ds*-'£ t "{2f(x k )}. 

J x 0 Z j=l 


A generalization of the repeated trapezoidal rule is known as the Gregory for¬ 
mula: 


rx n m , . 

/ /(t) dx = h (/o + /i + 2/2 + • • • + /at) + h ^2 c j+ 1 + (—1) J A J /o|, 

^0 j=o L J 


( 2 . 6 . 2 ) 


where 


c ' =( ~ 1) 7-, ("/)*■ 

This formula reduces to the repeated trapezoidal rule for m = 0. All values of 
Cj are negative. Some values of Cj are: c\ = —1/2, C 2 = —1/12, C 3 = —1/24, 
c 4 = -19/720, c 5 = -3/160, c 6 = -863/60480, c 7 = -275/24192, c 8 = 
-33953/3628800, c 9 = -8183/1036800, c 10 = -3250433/479001600. If m < 
N, the Gregory formula uses the values / (xi) for every Xi G [xo,xn]. If m = 2k 
(even) or m = 2 K + 1 (odd), the Gregory formula has an error of order /i m+2 . 
However, it provides an exact integration for all polynomials of degree 2k + 1. For 
example, if m = 2 and N > 2, the Gregory formula is 

/ f(x)dx & h (/o + fi + 2/2 + • • • + /at) —— (/o + /a) 

J Xo ° 

+ g (/1 + /iv-i) — 24 ^ ’ (2.6.3) 

which is exact if / is a polynomials of degree 3. 

S n : Repeated Simpson’s rule: 


pX2n 

Ia(f)= f{x)dx 

J Xo 


f(x 0) + 4 / (ar 2 ) + 2 / (ar 2 ) + 4 / (a; 3 ) 


+ 2 / (au) + • • • +4 / (x2 ra _i) + 2 / (a;2„) 


The coefficients in this rule follow the pattern: 1 2 4 2 4 ...2 4 2 4 1. 
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W n : Repeated Weddle’s rule: 

f Xn 2 h r 

I a(f)= /(ar) (ia: = — f (x 0 ) + 5 f (x^ + f (x 2 ) + 6 f (x 3 ) + f (x 4 ) 

Jx o IU L 

+ 5 / (# 5 ) + 2 / (# 6 ) + 5 / (^ 7 ) + / ( x s) + 6 / (xg) 

+ / Olo) + ••• + / (^n- 2 ) + / F (x n -i) + / (x n ) . 

For n = 6 it reduces to the basic Weddle’s rule. 

T n \ Repeated Tangent Rule: 

/ b n 

f(x) dx « h E f(Xk), 

k =0 

where Xk = ct + kh/ 2, with T n = b. Details of some of these repeated rules are given 
below. 

The trapezoidal rule is generally applied in its repeated (or composite) form T n . 
Assuming that / E C 2 [a, b] and taking h = (b — a)/n, we rewrite T n (f) as 

T n (f) = — (/o + 2/l + 2/2 + • • • + 2/ n _i + f n ) —— f"(f,)i 

Z iZ (2.6.4) 

— h (/o + fl + 2/2 + • • • + /n-l) + “ (fn ~ fo) 

-(Xn-xo )^/"(0, (2.6.5) 

where a <Z<b, and — To = nh. Note that the repeated trapezoidal rule T n 

consists of the repeated rectangle rule AE plus a correction term — (f n ~ fo)- The 

error term in (2.6.5) is of order h 2 and this rule is exact for all polynomials of degree 
one, because the second derivative in the error term is zero for such polynomials. 

The rounding error on /*. does not seriously affect the accuracy of the quadrature 
rule. Suppose that the rounding error in /*. is at most - x 10 -/c . Then from the rule 
(2.6.4) we get 

^ (1 + 2 + 2 H-1-2 + 1) x A 10 -fc = nh x 10 -fc = ^(b-a) 10 -fc . 

We use the Newton-Gregory forward polynomial (1.4.19) with n = 3 and integrate 
f(x) over [to, xf\. This gives 

r x 2 u u3 

J f(x)dx = - (f 0 + 4/i +/ 2 ) — — / (4) (C), x 0 <t<x 2 . 
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This is known as basic Simpson’s rule. The repeated Simpson’s rule requires an even 
number of subintervals. 

2.6.1. An Initial Value Problem. The above quadrature rules contain 
the weighted sum of the values Wi f (a+), where the nodes lie within the interval 
of integration [a, b] = [xo,x n \. However, sometimes we run into the problem of 
integrating a function f(x) over an interval [xo, x n +i], where x n = xq + nh, and 
the only known values of / are those at xo ,... ,x n . In such a situation we proceed 
as follows. Assuming that we have already computed the approximations at x = 
x n ,x n -i, ... , x n - m for m < n, we use the backward difference formulas (1.3.15) 
and (1.3.16) and obtain for any s > 0 

f(x n + sh)=Y J (-iy VVn + (~l) m+1 h m+1 ^f (m+1) (6) , 

(2.6.6) 

where x n - m < £ s < x n + s h, and /( m+1 ) is continuous on [x n _ m , x n + sh\. Now, 
we integrate (2.6.6) over the interval [x n ,x n +i\ by setting x = x n + sh, and obtain 


rx n+1 rn /*1 /_ \ 

/ f(x)dx = hJ2(~y j ^ j fn / . )dx 

JX n j = Q JO \ J / 


+ (-l) m+1 h m+2 




p(m+l) 


(6) ds 


m «l 

= YW / 

j=0 


— 5 


o V 2 


+ ft m+2 6 m+1 / (m+1) (6), 


(2.6.7) 


where 



( 2 . 6 . 8 ) 


and x n — rn < <^ s < x n _|_i. 

Another method is to use / (x n+ i) and construct the interpolating polynomial at 
the points x = x n+ i, x n ,... , x n - m for m < n. In this case we obtain 


m+l 


f(x n+1 + sh)=Y / (- +( “|V7n+l 

J=0 ' 3 


—s 


(~l) m+2 h m+2 [ ° )/ (m+2) (e+ (2-6.9) 

K m + 2 > 


Note that the interval x n < x < x n +i corresponds to — 1 < s < 0. Using the 
fundamental theorem of integral calculus we get 


px n+1 rn+1 

/ f(x) dx = h^2 Cj^fn+i + h n+3 c m+2 f (m+2) (r ] 3 ), (2.6.10) 

Jx„ j=0 
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where x n - m < r] s < x n +i, and Cj are defined by ( 2 . 6 . 2 ). 

Example 2.6.1. We consider the problem of integrating a first-order initial 
value problem involving the ordinary differential equation y f = f(x) between the 
limits x n and x n +\. The numerical solution is given by 

rx n+1 

y(x n+1 )=y(x n )+ f(x,y(x))dx. ( 2 . 6 . 11 ) 

J x, n 


The integral in (2.6.11) can be numerically solved, for example, by replacing the 
integral by an interpolating polynomial. Suppose we have already computed the ap¬ 
proximations 2 / 0 ? 2/i? • • • , 2M at the nodes Xk = xo + kh , k = 0,1,... , n. Now, to 
approximate the integrand f(x,y(x)) between x n and x n+ i we construct an inter¬ 
polating polynomial p m (x) through the m + 1 points (x n , f n ), (x n _i, f n - 1 ), • • •, 
(x n _ m , / n - m ), where m < n. This replaces (2.6.11) by 

px n -\-1 

y n +i=y n + Pm { x ) dx. (2.6.12) 

Jx n 

Using the backward difference formula (1.3.15) we get 


Thus, 


m /_ \ 

Pm(x) = E(-1) J ( 

rXn+l rXn+l m 

/ f(x,y(x))dx& p m (x) dx = h^bjW f n , (2.6.13) 

Jx n jx n j = 0 


where bj, defined by (2.6.8), are independent of both m and n. Some values of the 
coefficient bj are: b 0 = 1, b\ = 1/2, b 2 = 5/12, b 3 = 3/8, and 64 = 251/720. 
Hence, from (2.6.12) and (2.6.13) we find the solution as 


2/n+i =yn + h^2 bj^ J fn for n = m ,m + 1,... . (2.6.14) 

j=o 


This is known as the Adams-Bashforth formula for the initial value problem (2.6.11). 
If we expand the differences in (2.6.14), the solution reduces to 


2 /n+l — Vn fij f n —j •> (2.6.15) 

j =o 


where f3j depend on m. For example, form = lwehave^n+i = Un J r — (3 f n 
and for m = 3 we get 


Un + 1 — d n + 24 (^5/n — 59/ n _i + 37/ n _2 — 9fns) • 


/n— l), 
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The Adams-Bashforth algorithm of order 4 (i.e., m = 3) is 

1. Choose a step size h such that (b — a)/h is an integer. 

2. Start with T/o, T/i, 2/2, 2 / 3 - 

X := a -\- 3 h; Y := 2/3 
F 0 :=/(*, 2/3) 

F 1 :=f(X-h,y 2 ) 

F 2 :=f(X- 2 h, yi ) 

F 3 :=f(X- 3 h,y 0 ) 

repeat 

y := y + T (55 -Fo - 59Fi + 37F 2 - 9F 3 ) 

F : = F; F := F; F := F 
X :=X + h 
F 0 := f(X, Y) 
until X = b 

The local truncation error in the Adams-Bashforth formula is given by 

El ocal = h m+ 1 b rn+ 1 y( m+1) (£„), < F < a^n+i- ( 2 . 6 . 16 ) 


The global truncation error in this formula is bounded by 

ft TO+1 |Wi|M m+2 


^Global < 


L Bn 


(2.6.17) 


where max |?/ (m+2) F)| < M m+ 2 , = |/? 0 | + |/?i| + ••• + |/F|, and L 

x£[xo,b\ 

is the Lipschitz constant such that \f (x n , y (x n )) — f (x n ,y n ) | < L \y (x n ) — 
y n \. The bound in (2.6.17) is, however, of qualitative interest and does not provide 
any computationally useful information. For an implementation of this method, see 

AdamsBashf orth.m on the CD-R. 

Example 2.6.2. Solve y' = ^ + 2 , y{ 0) = 1, and 0 < x < 1. We 

have f{x,y) = ^ ^ 2 , and by the mean value theorem f(x,y) — f(x,z) = 
df(x , £) 

( 2 / — 2 ) — 7 ^ —, where £ lies between y and z. To satisfy the Lipschitz condi- 


dy 

tion f\x, y) — f(x, z)\ < L \y — z\, we choose L > 
x G [0,1] and y G (— 00 , 00 ). Since a maximum for 


df(x,y) 


-2 y 

dy 


(1 + v 2 f 


for all 


we take L = 
that 


df(x, 1/73) 




2 y , 1 

- 77 occurs at y = ±—=, 

(i + y 2 ) 2 7s 

Now, since f"(x,y ) = ——E, we find 


(i + y 2 T 


\v"{x)\ = \ f"(x,y(x))\ < 


10 y 2 - 2 


(i + y 2 ) 


= 2. 
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Thus, we choose M = 2. For the Adams-Bashforth formula of order 2, we have 
m = 1, 6 2 = 5/12, = |/? 0 | + |/?! | = 2, and thus, from (2.6.17) we have 


I y(x n ) - Vn | < (<5 + /i : 


= ft 


12 3a/3 2 

3V3x n /4 

9x/3^ 


3VS(a:„-0)/4 


10ft. 2 

VT 



8 2 
3a/3 2 


where <5 = max I y (xk) — Vk\- Then by taking h = 0.1, n = 10, and 6 = 10 5 , 

0 <k<m 

we get |x/(l.0) — 2/10 1 < 0.0172. This bound is considerably larger, because the 
values of y( 1.0) = 1.40629 and y 10 = 1.40584 yield |//(1.0) — 2/10 1 = 0.00045. The 

5 

local truncation error is i^LOcai = ^2 y'" (£n) = (0.1) 2 • — • (2.403486046) = 

0.010014525. - 


2.7. Romberg’s Scheme 


The classical Romberg scheme is a numerical integration procedure that amounts to 
using the Richardson extrapolation (§1.4.4) on the repeated trapezoidal rule. This 
scheme improves the accuracy in the Newton-Cotes formulas. This method is based 
on the trapezoidal rule which is written as 


pb n 00 

/ f(x) dx = h^2” fj +yy 

7 a A —n a — 1 


:h 2 \ 


3=0 i =1 

where h = (b — a)/n, and a& depend only on a, 5, and f(x). Let 

r b 


I = 


/ f(x) dx, 
J a 


and 

To ,k = 2k (2 f ^ ^ ^ ^2 fc -l + 2 fz k ^) 

denote the trapezoidal rule for 2 k subintervals of [a, b\. Then 


Define 


L 0,k 




b — a\ 2i 


2 k 


t i,fe 


1 

3 


( 4 To,fc+i 


To,fc) 


fc = 0,1,... . 


(2.7.1) 


(2.7.2) 


(2.7.3) 


(2.7.4) 
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Then, using (2.7.3) we get 


r u = '-Ei 


OO 


3 \2 2i - 1 


- f -E 


i=2 


3 \2 2i - 1 


ft — a 
2 k 

b — a 
2 k 


(2.7.5) 


k = 0,1, 


The approximation is known as the parabolic rule for 2 k subintervals. This rule 
approximates I using step sizes h\ = (ft — a)/2 k+l and ft 2 = (ft — a)/2 k , and has a 
leading term with the error of the order ft|. Thus, in general, we define 

Tm,k = -7 -- 7 (4 m T m _i fc+ i - T m _i fe), k = 0,1,... m = 1, 2,... . 

4 m — 1 

(2.7.6) 

This is known as the Romberg formula. Each T m ^ is a linear combination of 
trapezoidal rules using 2 fc , 2 fc+1 ,... , 2 2/c subintervals. Note that the approximation 
T 2?/c defines the composite rule using the Newton-Cotes closed formula for n = 4 
and 2 fc subintervals. However, for m > 2 the rule (2.7.6) has no direct connection 
with a Newton-Cotes repeated (composite) rule. The computations for T can be 
arranged in the form of Table R. 1. 

Table R.l. Romberg Table. 


7 o,o 



To,i 

Ti , 0 


^0,2 

^1,1 ^2,0 


To,m 

. 

^m ,0 


In the first column we use m + 1 computations of the trapezoidal rule and then 
use formula (2.7.6) to compute all the remaining entries in the above table. If / is 
Riemann-integrable in [a, 6], then T 0?m —» I as m —» 00 . Note that T m ^ has the 
leading term in its error of order of ((ft — a)/2 fc ), while has the leading term in 
its order of ((ft — a)/2 k ) 2 . Thus, we can hope that T m ^ converges much faster than 
To,k- 

We can write the Romberg formula (2.7.6) in the form 


— i Tc 


Tm,k — ^ ^ Cm,m—j 
3 = 0 


0 ,k+j 


(2.7.7) 
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which leads to the matrix equation 


' 7o,o ’ 
Ti, 0 

< 

> = 

Coo 

Cll CIO 


< 

' T 0 ,o ’ 
T 0 ,i 

> 

< Tm, 0 > 


- Cmm 

C m o - 


< To,m > 


The coefficients c mj are the coefficients of 

[Z ~ ^ Z ~ (4 - 1) (4 2 - 1) • • • (4 m - 1) ’ 

In particular, we have 


m 

\ C m3 

3= 0 


n 


3 = 1 


4 ? + 1 
4-7 - 1 


oo 


<n 


4 - 7 ' + 1 
4 - 7 ' - 1 ' 


(2.7.8) 


(2.7.9) 


(2.7.10) 


Since this infinite product converges, the sum of magnitudes of elements in any row of 
(2.7.8) is bounded. We find (2.7.9) that —► 0 as m —► oo, which implies that 

each column in (2.7.8) converges to zero. Finally, c mj = t m ( 1) = 1- Thus, 

the coefficient matrix in (2.7.8) satisfies the conditions for Toeplitz convergence; i.e., 
To ?m as well as T m? o converges to I. 

The Romberg method is based on the convergence of the above procedure which 
is an extension of the Richardson extrapolation and deals with performing M compu¬ 
tations, each using a different value of h , and then eliminating the first M — 1 terms 
in the error term in (2.7.3). The convergence in this procedure occurs only in the case 
of the trapezoidal rule (see Ralston-Rabinowitz, pp. 123-124). 

A simplified version is as follows (Phillips and Taylor 1996, pp.169). The Simp¬ 
son’s rule can be expressed as a linear combination of the midpoint and trapezoidal 
rules by 

S( h ,2) = llWizm . ( 2 . 7 . U) 

o 

Let / G C°°[a, b\. Then, using the Euler-Maclaurin formula (2.2.8), we can write 
I - T(h) = h 2 E 2 + h 4 E 4 + h 6 E 6 + • • • , (2.7.12) 

where h = (b — a)/n and 

E ^ = -^ (/ l “-' , (6)-/ ( “- 1| («)). 

and the coefficients B 2 u are the Bernoulli numbers (§2.2.2). If h in (2.7.12) is replaced 
by h/2, which doubles the number of subintervals, we obtain 
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Now we eliminate the h 2 term between (2.7.12) and (2.7.13) by multiplying (2.7.13) 
by 4, subtracting (2.7.12) and dividing by 3. This leads to 

I - T (1) (h) = h 4 E { 1 ] + h 6 E^ 1] H-, (2.7.14) 

where 

T^(h) = S(h/ 2), 

as defined by (2.7.11), and E^\ E ^\... are multiples of E \, Eq, _Note that 

T^^/i), defined by (2.7.14), provides a better approximation to the integral I for 
sufficiently small values of h than provided by either the trapezoidal rule T(h) or 
T(h/ 2). 

The above process of eliminating the leading power of h in the error term is the 
Richardson extrapolation (see § 1.4.4). If we continue this process further, eliminating 
terms in h 4 between T^\h) and T^\h/ 2), we obtain 

I - r (2) (/i) = h 6 Ef 1 + h 8 A 2) + • • • , 


where 

r® ( „) = 16r ' 1| ('^)- rll >('‘). (2.7.15) 

where the numbers E^\ E$ 2 \ ... are multiples of E^\ E^\ ..., and hence, mul¬ 
tiples of Eq, Eg ,.... In general, continuing this process to k steps further, we obtain 


where 


i - A) =/i 2(fe+1) 4S +1) + -”> 


T (fe) (fi) 


4 fe T^-^ih/Z) -T( k ~V(h) 
4 fc — 1 


(2.7.16) 


(2.7.17) 


This is the Romberg formula. To compute (fi) we need to compute the trape¬ 
zoidal approximations T(h), T(h/ 2), T(h/ 4 ),... ,T (h/ 2 fe ). This can be arranged 
in the form of Table R.2 which is designed for k = 3. 


Table R.2. Romberg Table. 


T(h) T^\h) T^(h) T^(h) 

T(h/ 2) T^\h/2) T^\h/2) 

T(fi/4) T^lh/4) 

T(h/ 8) 


Example 2.7.1. (Phillips and Taylor 1996, p. 171) Apply the Romberg formula 

dx 

with n = 1 and k = 3. The correct result to six 


to compute the integral 


/ 


l + x 
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decimal places is 0.693155 (Mathematica value is 0.693147). Note that 0.25 < 
f(x) < 2 for 0 < x < 1. Applying the above algorithm we obtain the answer as 
0.693148 (see Table 2.7.1). - 

Table 2.7.1. 

0.750000 0.694444 0.693175 

0.708333 0.693254 0.693148 

0.697024 0.693155 

0.694122 

Example 2.7.2. (Phillips and Taylor 1996, p. 172.) Compute J 0 °' 8 ^fxdx. 
The value correct to six decimal figures is 0.47703 (Mathematica value is 0.477028. 
The integrand is not differentiable at x = 0. We take h = 0.8/2 n for n = 0,1, 2, 3,4, 
and the results using the above algorithm are presented in Table 2.7.2. Note that the 
two boxed values are not correct. 

Table 2.7.2. 

0.35777 
0.43187 
0.46030 
0.47092 
0.47482 

Note that just looking at the last entries of the columns may not give us the correct 
result. We should look for the signs of convergence as we look down each column in 
the Romberg table of extrapolated values. ■ 

, 1.5 

Example 2.7.3. (Geraldand Weatley 1994, p. 334) Compute I = / e~ x dx 

J 0.2 

(Mathematica value is 0.658823). By taking h = (b — a)/ 2 = 0.65, the first estimate 
is 

/ = | [/<«) + 2/(0 + h) + m] = 2|5 [ e -0.2- + 2e -0«- + 

= 0.66211. 

For the next estimate we take h = 0.65/2 = 0.325 and get 

I = — [f (a) + 2/(a + h) + 2/(a + 2 h) + 2/(a + 3 h) + /(&)] 

= ^ [ e -°- 22 + le -°' 5252 + 2 e -°' 852 + 2 c - 1 ' 1752 + e ” 1 ' 52 ] 

= 0.65947. 



0.693148 
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Now we extrapolate to obtain 

0.65947- 0.66211 

Improved Value = 0.65947 H---= 0.65859. 

o 

This process continues until the values finally match. This is shown in Table 2.7.3 as 
the boxed value. ■ 


Table 2.7.3. 


0.66211 

0.65947 

0.65898 

0.65886 


0.65859 

0.65881 

0.65882 


0.65882 

0.65882 


0.65882 


Example 2.7.4. (Gerald and Weatley 1994, p. 335) Consider the function f(x) 
tabulated in Table 2.7.4a. 


Table 2.7.4a. 


X 

f(x) 

i * 

f{x) 

1.6 

4.953 

| 2.8 

16.445 

1.6 

6.050 

3.0 

20.086 

2.0 

7.389 

3.2 

24.533 

2.2 

9.025 

| 3.4 

29.964 

2.4 

11.023 

3.6 

36.598 

2.6 

13.464 

3.8 

44.701 


Compute the integral of this f(x) between the limits x = 1.8 and x = 3.4. For 
h = 0.2 the first estimate is 

I = ^2 [6.050 + 2(7.389) + 2(9.025) + 2(11.023) + 2(13.464) 

+ 2(16.445) + 2(20.086) + 2(24.533) + 29.964] 

= 23.9944. 

Now we take h = 0.4, which gives the next estimate as 

I = ^2 [ 6 .050 + 2(9.025) + 2(13.464) + 2(20.086) + 29.964] 

= 24.2328. 

Using extrapolation we get 

Improved Value = 23.9944 + 23 - 9944 ~ 24.2328 = 23 gi4g 

o 
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The results of this process are shown in Table 2.7.4b. 

Table 2.7.4b. 


ft = 0.2 23.9944 23.9149 23.9147 

ft = 0.4 24.2328 23.9181 

ft = 0.8 25.1768 


Example 2.7.5. (Kythe and Wei 2004, p. 72; Bickford 1990, p. 184) Solve by 
using the method of finite elements the heat transfer problem: 


d_ 

dx 


(kA^j +(3pT = qA , 


0 < X < L, 


subject to the boundary conditions T(0) = T 0 and T(L) = 0 for a circular bar whose 

radius varies linear from ro at x = 0 to ro/4 at x = L (see Fig. 2.7.1, page 540), 

/ 3x \ ^ f 3x \ 

where A(x) = A 0 p - — J , A 0 = n r%, and p(x) = p 0 ( 1_ 4 ^)’ Po= 27rr °’ 

by taking a mesh of 2, 4, 8, 16 and 32 equally-spaced linear elements. We take 
u = T/Tq, s = x/L. Then the problem reduces to the nondimensional form 


d 

ds 



du 

dx 


+ {cLf ^1 - E) „ = QL 2 


u{ 0 ) = 1 , u{ 1 ) = 0 , 



0 < s < 1, 


. 2 Ppo . n q 

where c = ——, and Q = —. 

kA 0 k 

We will improve the value of ix(0.5) by using the Romberg method. The Romberg 
table is presented in Table 2.7.5, in which the second column shows the values of 
^(0.5) for the type of mesh mentioned in the first column. The extrapolation is carried 
out in the remaining columns. ■ 

Table 2.7.5: Extrapolation for the Values of ^(0.5). 


2-Element Mesh: 
4-Element Mesh: 
8-Element Mesh: 
16-Element Mesh: 
32-Element Mesh: 


0.757314 

0.769871 

0.774604 

0.775999 

0.776366 


0.774057 

0.776182 

0.776464 

0.776488 


0.776890 

0.776558 

0.776497 


0.776447 

0.776476 


0.776476 


Since Romberg integration is an extrapolation problem, one must be careful in 
the application of this scheme. 
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2. INTERPOLATORY QUADRATURE 


2.8. Gregory’s Correction Scheme 


If f(x) is sufficiently differentiable with respect to x € [a, b], a deferred correction 
is used to obtain the approximate solution I by using Gregory’s correction. Suppose 
that an initial approximation I = is found after using a quadrature rule, say a 
repeated trapezoidal rule with step size h = (b — a)/n. Then we should compute 
only the vector 1^ = [i^ (a), 1^(a + h) f ... , 1^ (6)] T , where 

n 

I^(a + ih) — A h " k (a + ih, a + jh) 1^ (a + jh) = f(a + ih ), (2.8.1) 

j=o 

for i = 0,1,... ,n (compare this with the repeated trapezoidal rule). If we use 
Gregory’s method instead of the repeated trapezoidal rule, we get 


I h(a + ih) — A Ih " k (a + ih, a + jh) 1^ (a + jh) + ^ (I) > = f(a + i/i), 

^ l=o ^ 

( 2 . 8 . 2 ) 

for i = 0,1,. .. , n, where ^ (I) is Gregory’s correction term to the repeated trape¬ 
zoidal rule, defined by 


S i (I) = h y] C ^{v m ^(I;6) + (-irA m ^(I; a )}, p < n, 

ra=1 

(I; 6) = A m ??i(a;) 


x=b 


(2.8.3) 


V m $j (I; a) = A m ‘d i (x) , 

x=a 

$i(x) = (I; x) = k(a + ih, x) I(x). 


This method uses the forward and backward differences A m and V m , respectively, 
defined for m > 1 by 

A ra tf(a;) = A TO_1 $(:r + h) - A"*- 1 0(a;) 1 
V m $(x) = A m i9(x - mh), 


such that 

m , \ 

A ra tf(a;) = + m/i) = ^(-l)j +m f m j 0(® + jh), 

j=o ' 

coefficients are defined by the recursive formula (see Henrici 1964, p.252) 


4 = i, 




[1 

E c: 


m—1 


rn - 


m = 1 , 2 ,. 
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1 1 1 19 3 

Some values of are: cj = -, 4 = - —, , 4 = - —, 

863 

4 = — t-t—t:- Thus, we can write the trapezoidal rule with Gregory’s correction 


-6 

as 


160480 


/ ~ — /(a) + 2/(a + ft) + 2/(a + 2 h) + ... + 2/(6 — h) 

+ /(&)] - T (V/(6) - A/(a)) - T ( V 2 F(6) - A 2 /(a)) 
- ^ (V 3 /(&) - A 3 /(«)) - ^ (V 4 /(6) - A 4 /(a)) 


(2.8.4) 


160 


863/i 


(V 5 /(fr) — A 5 /(a)) , 


60480 

and so on. For an application of this scheme to integral equations, see §10.3. 


2.9. Interpolatory Product Integration 

We will construct a quadrature rule for an integral with an integrand that is the product 
of any two functions w(x) and f(x) over an interval [a, b\. Such a rule is of the form 

[ w(s)f(s)ds = jTv j f(s j ), (2-9.1) 

Ja j=0 

where Sj are the nodes, a <Sj<b, and the weights Vj depend on a, b as well as the 
function w{x). If the function w = 1, the rule (2.9.1) reduces to the quadrature rules 
presented in previous sections and Chapter 3. We discuss two cases: 

Case 1. If the function f{x) is “badly behaved”, e.g., f(x) behaves like {x — 
s) -1 / 2 near x = s but is continuous everywhere else, we can find a function g(x) 
such that f(x) = g(x)(x — s) -1 / 2 . In general, if we approximate f(x) by using a 
polynomial interpolant 


,n( x ) — ^ h( x ) f ( S j)i 

3=0 


where lj (x) 
then 


n 

i =0 
i^3 



, which agrees with f{x) at the nodes Sj , j = 0,1,... , n, 



^2 v jf( s j), 


3=0 
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where Vj = J^ w(s) lj(s) ds. Since / G (7[a, 6], we choose the nodes so, si,... , 
such that P 0 ,i,.. ,nW is a reasonable approximation of f(x). 

Example 2.9.1. Suppose so = a, si = b , and /" e C[a, &]. Then Z 0 (x) = 
b — x , , , N x — a , . , . _ /x b — x ^ x — a 


b — a 


and h(x) = 


, which gives Po,i,... , n (x) = , 
b — a b — a 


f( a ) 


b — a 


m. 


and 


, where 


[ w(s)f(s)ds = v 0 f(a) + v 1 f(b), 

J a 

[ b b-s i w t 

/ - wis)ds , v\ = 

Ja b- a J a 


Vo = 


b — a 


w(s) ds. i 


Case 2. For integral equations of the form J a 6 k(x, s)c/)(s) ds , we keep x fixed, 
write rc(s) = k(x , 5 ), and get an integral of the form (2.9.1), where the function rc(x) 
may be well behaved, or it may be badly behaved as, e.g., in the case of weakly singular 
integral equations where w(s) may be of the form \x — s\~ a g(x, s), 0 < a < 1. If 
(j) G C n+l [a, b], and a < Si < 6, z = 0,1,... , n, then there is a value £ depending 
on a such that 


0(a;) - P 0 ,i,... , n (x) 


(n + 1)! 


IF-u • 

i =0 


Hence, in the case when a and b are finite, 




,n(s) ds 



£>( n+1 )(£) 

(n + 1)! 


n 


IF 5 


— Si) ds , 


where £ = £( 5 ). If in (2.9.1) we set 


/ nf 

Ja a _l a b 3 


Si 


ds , 


. / • -j E 


then the error E in the above approximation is bounded by 

r b 


\E\ < ||0 ( 


n+l)(x) I 


/ U4llf 

Ja A , A b 3 


~ Si 


• / • u 3 
1^3 


ds , 


provided |td(^) | ds < 00 . This leads to the quadrature rule 


(2.9.2) 


/ b n 

k(x, s) (j)(s) ds = (2-9.3) 

3 =0 


which is exact when cj)(x) E V n . 


2005 by Chapman & Hall/CRC Press 





2.9. INTERPOLATORY PRODUCT INTEGRATION 


85 


To obtain an improved approximation, partition [a, b] at the points Sj, j = 
0,1,... , n, by a = sq < si < ... < s n = b, and write 


71—1 


77—1 


I w(s)f(s)ds = J2 f w(s)f(s)ds = +Y ) /( s j+i)}. 

J a a n J Sn a n ^ ^ 

(2.9.4) 


j=o ^ 


3=0 


where 


(j) / £j + l £ / \ 7 

+n = / —- w(s)as , 


/: 


5 j+l 


S J + 1 Q _ 


8 — Si 


(2.9.5) 


■ w(s) ds. 


£j + l £j 

The approximation is still of the form (2.9.1), and the error is bounded by 


\E\< 



w(s) (s — Sj) (s — Sj+i) ds, 


which is of the order O (h 2 ) at Sj = a + j h,h = (b — a)/n , provided J a 6 ^(s) | ds < 
oo. This quadrature is known as the generalized trapezoidal rule since it 
is an extension of the repeated trapezoidal rule. A generalized midpoint rule 
is obtained by taking n even and setting Sj = a + j h as above, with vq = +2 = 
V 4 = ... = 0, and V 2 m+i = f S2m+2 w(s)f(s) ds for m = 0,1,... . This rule is 
exact if f(x) is piecewise-constant, i.e., constant in each subinterval [s2 m ? £ 2777 + 2 ]- 
An extension of Simpson’s rule is obtained for even n by setting Sj = a + j h, as 
above. Then in the subinterval [s 2 m , £ 2777 + 2 ] the function f(x) is approximated by 
the interpolant 




[2 ^ £2777+1) (t £2777+2) / (£2777) T (t £2777) (t £2777+2) 

x / (£2777+1) T ~ (t £2777) (t £2777+1) / (£2777+2) 


This gives the generalized Simpson’s rule: 



rS2m + 2 71 ^ 

^2 / w(s)P 0 ,i,...,n(s)ds = '22 / v j f (sj), (2.9.6) 

777 = 0 j= 0 
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where 


-j- na-\-2h 

v ° = 2Tfi J (s - Si) (s - s 2 )w(s)ds, 

l r s 2 j +2 

V 2 j+l = -^2 J ( s ~ 5 2 j) (s - s 2j+ 2 ) w(s) ds, 


1 ( 

V2j = 2h?'' ( s “ S2j_2 ' ) ^ ~~ S2j ~^ dS ’ 


( 2 . 9 . 7 ) 


S2j-2 


r s 2j+2 . 

+ / (s — s 2 j + i) (s — s 2 j +2 ) w(s) ds j-, j^Oorm, 

Js2j J 

1 f b 

= 2 h? J ( s ~ S 2m-2)(S ~ S 2 m-l)w(s)ds. 


If f"(x) G C[a, b], then the error in this rule is of the order O ( h 3 ). Note that the 
error may not be of the order O (/z 4 ) even if /^ (x) G (7[a, b\ unless w{x) = 1 (see 
Wang 1976). 

If the function w(x) is of the form (x — s)~ a g(x , 5), then the generalized 
trapezoidal rule is obtained by taking a = 1 / 2 , Sj = a + j h, as above, 
g(x, s) = 1, and x = s m , m = 0,1, ... , n. Then 


/ b n 1 

(«m - S )~ 1/2 f(s ) ds = Y^ Uo^rn f (Sj) + f {s j+1 ) , ( 2 . 9 . 8 ) 

j=o 


where 


J j ) - 

U 0 ,ra “ 


w o) _ I 

u i- m “ /i 


^ 1/2 da, 

^ 1/2 ds. 


I r s o +1 

j ( S j +1 — 5 ) ( 5 m — 5 ) 

J s 3 

r s J +1 

/ ( 5 - G ( 5 m - «)' 

Jsj 

Alternatively, if we set 

/>a />a 

V’o(^) = / (1 — s)|r — s| -1 / 2 ds, ipi(r) = / s|r — s | -1 / 2 ds, 
Jo Jo 


( 2 . 9 . 9 ) 


then 


where 


Ji) 

y 0,TO 


= Vhip 0 (m-j), vY t } m = VhMm-j), ( 2 . 9 . 10 ) 


V’o(f) = ^2 O’) - OA), 


OiO’) = 3 
ip 2 (r) = 2 


(r — l) 2 


3 L|r — l ) 1 / 2 |r|!/ 2 j 

r r — 1 


| r |i/2 |r — 1| 1/2 


rip 2 (r), 
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Further, the quadrature rule for w(s) = In s m — s is given by 


/ 

J a 


n — 1 


In 


|Sm - s\ f(s) ds = / Oj) + / A + l) 

3=0 

where by setting 

M r ) = / (1 - s) In \r - s\ds, 

Jo 

r 

^i(r) = s In \r — s\ ds , 

Jo 


we have 


Vo,L = ^hlnh + hipo(m-j), 
A% = ^ h ln/i + - *); 


or, alternatively, ^(r) = ^2(7) — Vr(r), where 

^i( r ) = ^ {^ r — l r — 1| — r2 l n M + ^ [f 2 — (r — l) 2 


i/j 2 (r) = r In |r| = (r — 1) In |r — 1| — 1. 


A word of caution: While computing above formulas for Vq ^ and 
cancellation error take the limit values as r —» 0 or r —» 1. Also, not 
GENERALIZATIONS OF THE MIDPOINT RULE for even 7 V. 


and 


/ 


f 


n/ 2—1 


where 


| Sm <51 7 f(s)ds= ^m +1 /(a+(2j + l)/l) 

J=0 


n/2-1 

ln|s TO — s|/(s)ds = ^ ui^ +1 / (« + ( 2 J + 1)M » 

j=0 


w m — u 0 ,m ^ U 1 ,m ^ U 0 ,m ^ U 1 ,m ? 

w m — u 0,m + U l,m + U),ra + M,ra 


Thus, 


w. 


(2J + 1 ) = 2\A 


rn — 2j 


m — 2j — 2 


|m — 2JI 1 / 2 | m — 2 j — 2|V 2 
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(2.9.12) 


+ U 2 (r), 


(j) 

Vi m , to avoid 
j the following 


(2.9.13) 


(2.9.14) 
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whence by taking the limit values we get 

«4?K“ = «4 T" = 2 ^ 


Lastly, the generalized rules can be extended to the case when f(x ) is the poly¬ 
nomial interpolant. For example, let h = (b — a)/ n, and n = Nm, where N and m 
are integers; set Sj = a + j h, j =, 1,... , n. For < x < s/ m + m approximate 
/(x) by the interpolant P 0 ,i,... ,n(z) = Pz m ,Zm+i,... ,/m+m(T) of degree m such that 
Po,i,.. ,n( x ) agrees with f(x) at the points si m , sz m+ i ,, s/ m+m . Then 


rb N 1 pSim + r, 

/ w(s)f(s)ds =J2 

J a 1=0 ’ s lm 


w(s)P 0 ,i ,„(s) ds = ^ Vj f ( Sj ), (2.9.15) 

j=0 


where 


Vi = < 


v lm+i — f s 


n 


j^lm+i Slm+i Sj 

'-’j 

, rs/rri rrZra-1 5 — s j 

^ il Im- 


S — S' 

J= i m --— w(s)ds if j = Im + z, z 7 ^ 0 , 


■ w(s) ds if j = Im. 


Sj 

(2.9.16) 

2.9.1. Application to Integral Equations. Ar modification of the 
quadrature method in the case when the kernel k(x , s) of an integral equation 
is badly behaved at x = 5 , i.e., when it is discontinuous or when one of its derivatives 
is discontinuous at x = s, consists of writing the integral equation as 

(j)(x) - A <f>(x) f k(x, s ) [0(s) - <j>{x)\ ds = f(x), 

J a 

and using a quadrature rule to obtain 

n 

{l — A A(x)} (j>(x) — A ^ Wj k (t, Sj) {(f) ( Sj ) — 4>(x)} = f(x), (2.9.17) 

3 =0 


where A(x) = k(x, s) ds. If we use the notation 

n 

A (x) = k (x, Sj) — A(x), (2.9.18) 

j=o 

we obtain from (2.9.17) 

n 

{l + A A(x)} (j){x) — A Wj k (x, Sj) <j) ( Sj) = f(x). (2.9.19) 

j=o 
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If we set x = x i9 i = 0,1,... , n, in (2.9.19), we have the modified quadrature 

RULE 


{l + XA(xi) } 4>(x) - A Y'WjkixuSj) <t>(sj) = f(xi), (2.9.20a) 

3=0 


which in matrix notation is 


(I + A (A — KD) ) <1 = f , (2.9.20b) 

where I is the identity matrix, k = (fc Sj))^, A = diag{A (x 0 ), A (xi) ,..., 
A (x n ) }, and D = diag{rco, wi, • • • , uj n J. Note that the integral A(x) needs to be 
computed accurately, either analytically or numerically, for this method. 


2.10. Iterative and Adaptive Schemes 


The production of automatic integration codes has been a favorite research topic since 
the 1960s. A number of automatic integrators have been developed to numerically 
integrate a function of one or more variables over a finite interval. Initially only 
functions of one variable were considered. These computer programs are said to be 
user-friendly, in the sense that the user enters the limits of integration, selects the 
routine for computation of f(x), provides a tolerance e, and enters the upper bound 
N for the number of functional computations. Then the program exits either (i) with 
the computed value I of the integral which is correct within the tolerance, which 


means that either I^(f) — 7 < e, or 


\W)-I I 
4UI/I) 


< £, or (ii) with a statement 


that the upper bound N was attained but the tolerance was not achieved, and the 
computed result may be the “besfi’value of the integral determined by the program. 
More sophisticated programs require, for example, that 


Ia(f)~l\ < max j£ abs ,£rel R«(/)|}, 


where £ a b s and s re \ are absolute and relative tolerances, respectively (Rice 1971). 

Automatic integration falls into two classes (Shampine and Allen 1973, p. 67ff): 
iterative or noniterative, and adaptive or nonadaptive. The iterative schemes consist 
in computing successive approximations to the integral until an agreement with the 
prescribed tolerance is achieved, but in noniterative schemes the information from 
the first approximation is carried over to generate the second approximation, which 
then becomes the final result. In adaptive schemes the points at which the integration 
is carried out are chosen in a manner that is dependent on the nature of the integrand, 
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whereas in nonadaptive schemes the integration points are chosen in a fixed manner 
which is independent of the nature of the integrand, although the number of these 
points depends on the integrand. 

An integration rule must not only approximate the value of an integral as closely 
as possible but also assess its error and try to produce a numerical value that satisfies 
certain accuracy criteria imposed by the user. Naturally more accurate results may 
take more computer time. In order to balance the computer time vis-a-vis accuracy, 
we need an iterative method that computes a sequence of approximate values with 
increasing accuracy and terminates with the best value when its accuracy requirement 
is satisfied. 

2.10.1. An Iterative Method for Simpson’s Rule. Consider Simpson’s 
rule (2.5.6). Consider the first approximate value I^{f) « Si(/). Now, partition the 
interval [a, b] into several subintervals. Suppose, for example, in the case of bisection, 
i.e, a partition in half, we consider I^if) « S 2 (f). We can assume that the error 
in S 2 (f) is smaller than the difference \S 2 (f) — Si(/) |. To be more precise, let us 
assume that f(x) is smooth. Then from (2.5.5) we have 


I b a(f) = Si (/) - / (4) (Cl), a < 6 < b. 

We apply this result to each half subinterval and get 

r(a+b)/2 pb 


I° n (f) = / f(x)dx + 

Ja J(c 


( a + 6)/2 


f(x) dx 


where a < £21 < 


S 2( f ) ~ 1 [/ (4) (C2l) + / W (C22) ] , 

cl b 


< £22 < b. Let us further assume that the interval [a, b] 


is small enough so that we can take /^( x ) as a constant quantity denoted by 
Then 


ilU) » S 1 (f) ~ 
I b a {f) » S 2 (f) ~ 


\b ~ 1 


2880 

| b — a| 5 


/ (4) , 


f(4) 

2880 J 2 4 ’ 


which gives 


Hence, 




I b (f)-s 2 (f)^^[s 2 (f)-s 1 (f)]. 


( 2 . 10 . 1 ) 
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This relationship enables us to compute the error in the repeated Simpson’s rule. Since 
the rule S n (f) applies to n equal subintervals [a + (fc —1) ft, a + fcft], k = 0,1,... , n, 
of the given interval [a, 6], we apply the rule S2n(/)> which amounts to the bisection 
of each of these subintervals and the application of the Simpson’s rule to each part, 
and use formula (2.10.1) to estimate the error over each N subintervals. If we add 
all approximate integrals and the error terms, we get 


I b a U) ~ S2n(f) » T[5 2n(/) - Sn (f)]. 


For example, let us compute an approximate integral Q(f) such that 1 1 a (/) — Q (/) | < 
e, where £ > 0 is a prescribed quantity, often known as the tolerance. We com¬ 
pute a sequence of approximations S 2 fe (/), k = 0,1,..., and check the difference 


S 2 ^{f) ~ S 2 k {f) 


. When this difference becomes less than £, we stop and take 


S 2 k +1 (/) as Q(f). In fact, we only compute the error to be less than s/lb. Or, we 
may compute the value of 


Q(f) = s 2 k+i(f) 


i 

15 


sWi(/)-s 2fc (/) 


which removes the estimated error. 

Remember that in this kind of iterative method the assumption that the quantity 
/ is taken as constant is important. Such an assumption is valid if /^ is continuous 
and N = 2 k is taken sufficiently large and £ is small. However, one must be quite 
suspicious if the above formula terminates while N is quite small. But then it may 
be the case because the problem was initially simple. 

This method becomes inefficient in one respect. Since the interval [a, b] is divided 
into many subintervals, and we compute two approximations S 2 (/) and Si (/) in each 
subinterval, we partition again if the agreement is not satisfactory,. The agreement 
may be satisfactory in almost all subintervals, but we may encounter a large disagree¬ 
ment in one subinterval, which may affect all subintervals. This situation is remedied 
by adaptive processes which are described below. 

2.10.2. An Adaptive Quadrature with Trapezoidal Rule. The 
quadrature rules generally assume that all integrands behave uniformly in the interval 
[a, ft]. But most functions (integrands) vary more rapidly in one part of the interval 
[a, ft] than in another. As such the quadrature rules undergo certain disadvantages 
which can be corrected by using an adaptive quadrature formula. We will use the 
trapezoidal rule T% to approximate the integral I%f in such a way that \ l%f— T%\ < e, 
where £ is the specified tolerance. This is achieved by splitting the interval [a, ft] into 

a sequence of subintervals [xi-\,Xi\ of length hi = Xi — Xi-i, i = 1_, n, with 

To = a and x n = ft. Then the total combined error from each subinterval is given by 

Et = -777 /" (&) , Xi_ 1 < 6 < Xi, i = 1 ,... , n. 
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Note that the magnitude of this error depends on hi and f" (^); thus, in the case 
when \ f" (<^) | is large, we need a smaller hi to control the error. This means that we 
choose the sizes of the subintervals such that the contribution to the error from each 
subinterval is approximately the same. Let I% % and denote the integral and 
its trapezoidal approximation in the subinterval [xi-i,Xi], respectively. If 


TX t _ rpx z 

1 X % -\ - L X x -\ 


< 


hi £ 

b — a 


then the total error will be less than e. This process starts by obtaining the approxi¬ 
mation by the trapezoidal rule on the entire interval [a, b\. Thus, we have 

n = —7j— [/(«)+ f( b )} = y ie®) + where h o = b ~ a - 

The next approximation Tq is obtained by splitting the interval [a, b] into two equal 
subintervals of size hi = ho/2, i.e., 


\y [/(«) + 2 /(« + y) +/( & ) 

\ [ T o+ h of(a+ y)} 

Itq 1 + hif {a + hi) where ft.i = y 


The errors in these two approximations are 


i~n = 


I ~ T o = 


r(6) 

12 


hi 


a < £i < b, 


V" ( 6 ) 

12 V 2 


(y) 3 ’ a <^< b - 


( 2 . 10 . 2 ) 

(2.10.3) 


The factor 2 appears in the error estimate (2.10.3) because of integration over two 
subintervals. Let us assume that f"(x) is almost constant on the interval [a, 6], say, 
equal to f"(r /), then subtracting the above two error estimates we obtain 


To ~ U 


/"(??) 

12 



which gives 


r(v) (ho\ 3 _ n-n 

12 V 2 ) 6 


(2.10.4) 


If we substitute (2.10.4) into the right side of (2.10.3), we obtain the error estimate 


I- 


rji2 

J-O 


1 

3 


|To - To | 


(2.10.5) 
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This shows that the error in the second approximation T§ is approximately one-third 
of the difference | T§ — Tq |, which can be easily computed. Thus, if the error 



< 


( 2 . 10 . 6 ) 


then we accept Tq as the required approximation of 1%. But if the condition (2.10.6) 
is not satisfied, then we first consider the left subinterval [a, a + hi] and then to the 
right subinterval [a + /m, b], and obtain the approximations to the integrals in those 
intervals, which satisfy a condition of the type (2.10.6) with tolerance s/2 instead 
of e. This process is repeated over the subinterval where the condition of the type 
(2.10.6) is not satisfied, until the approximations to the integral over each subinterval 
becomes accurate within the proper tolerance. 


Example 2.10.1. (Atkinson and Hatley, p. 238ff) Compute —dx using 

the above adaptive method. Note that the exact value is In 2 = 0.6931. We will take 
the tolerance as £ = 0.005. First, we compute Tq over the entire interval [0,1]: 


T 1 — 


1/1 1 
2 VI + 2 


3 

4 


0.75. 


We split the interval into two equal subintervals, and compute 


rp2 

1 0 


0.5 rl / 1 

— - +21 - 

2 Ll V1 + 0.5 


= 0.7083, 


l \ T o ~ T o\ = 0.0139 < 0.005 = e. 

O 

Thus, the tolerance is not satisfied in this interval size. So we consider the first 
subinterval [0,0.5]. Here h = 0.5 and the error estimate is s/2 = 0.0025 The 

first approximation on [0,0.5] is Tq = ^ ^1 + ^ =0.4167, and the second 

o 0.5 r /4\ 2i 

approximation is T 0 = — l + 2^-J+- = 0.4083. Then the error estimate is 


\ |T 0 2 - Tq 1 ) = i |0.0084| = 0.0028 ^ 0.0025. 

o o 


Thus, the error estimate Tq is not sufficiently accurate. Next, we split the interval 

[0,0.5] into two subintervals [0,0.25] and [0.25,0.5] and consider the integral in 

each, with tolerance s/4 = 0.00125 in each. On the subinterval [0, 0.25] we find that 

0.25 / 4\ 9 0.25 

1 + -J = 0.225, and T 0 2 = — 


T 1 — 


1 + 2, 9 


4i 

5 


= 0.2236. The 


error estimate is 


i |Tq - Tq 1 | = i (0.0014) = 0.0005 < 0.00125. 

o o 
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This is the first contribution to the integral over the entire interval, which we write 
as sumi = 0.2236. Next, we consider the right subinterval [0.25,0.5], in which 


T 1 — 


0.25 


error estimate is 


1 + A = 0.1833, and T 0 2 = ^ 
5 3/ u 4 


4 „/ 8 

L5 +2 (U 


2 

3J 


= 0.1826. The 


I |T 0 2 - To 1 ) = I (0.0007) = 0.0002 < 0.00125. 

o o 


We write this contribution as suni 2 = 0.1826. Adding these two contributions we 
obtain Iq (/) « sumi + sum 2 = 0.2236 + 0.1826 = 0.4062. Next, we consider the 
right half interval [0.5,1], in which the tolerance is 0.0025. In this subinterval we 
~ ~ " 2 /4\ li 


have Tq 1 = (| + = °- 2917 ’ and T o = ^ 

The error estimate is 


L3 +2 U 


2J 


= 0.2887. 


- Tq - U = - (0.003) = 0.001 < 0.00125. 


We write this contribution as suni 3 = 0.2887. Adding this contribution to the previous 
sums, we find that l£(f) « 0.4062 + 0.2887 = 0.6949. Since |0.6931 - 0.6949| = 
0.0018 < 0.005, we stop the adaptive process. Thus, the approximate value of the 
integral is 0.6949. ■ 


The adaptive process can be based on any quadrature rule, and its accuracy is 
based on the number of points involved. Below we describe the adaptive process 
based on the Simpson’s rule; this process is often used. 


2.10.3. An Adaptive Method Based on Simpson’s Rule. We will 
discuss the adaptive scheme for the Simpson’s rule. Let L = b — a denote the length 
of the interval [a, b\. First, we divide this interval into two equal parts, and compute 


Qi(f) = L-\- [/(a) + 4/(§)+/(&)' 


and 


<?„(/) = ( 1) 4 

Qnif) =(§) 4 


Then ask 


/(a) + 4/(a+l) +/(1) , 

/ ( a + ^ ) + 4/ (a + —) + f(b) 


Is |Qi — (Qn + Q 12 ) 


< £? 


If the answer is ‘yes’, then Qn + Q 12 is the result, i.e., J ^ f(x) dx « Qu + Q 12 . 

If the answer is ‘no’, since Qu = C L/2 f(x) dx , we take the first half interval 
[a, a + L/2], divide it into two equal parts, and compute 


Qin(f) 

QiMf) 


L 

¥ 

L 

¥ 


L 


• g • f(a)+4:f(a 

'U [ / ( a + l) +4/ ( a + T 


L 

4 

/< 



2005 by Chapman & Hall/CRC Press 



2.10. ITERATIVE AND ADAPTIVE SCHEMES 


95 


Then ask 


Is \Qu — (Q 111 + Q112) 


< e/2? 


If ‘yes’, then J ^ +L//2 f(x) dx « Qm + Qii2- If ‘no’, repeat this process on the 
right half interval [a + Z/2, 6], and compute 


Ql 2 l(/) = 

Q122(f) : 
Then ask 


1 


2 2 

L 

22 


2 

, 3L 

/(a+ T 


+ 4/ ( a + — 


+ /( a + 


4/ a 


-) 
8 / 


3L\ 

tJj’ 


-/(&) 


Is |Ql2 — (Ql21 + Q122) 


< e/2? 


If ‘yes’, then f b +L / 2 f( x ) ~ Q121 + Qi22- If ‘no’, repeat the third and fourth 

quarters of the interval [a, b] by asking the question for each quarter, and continuing 
this process of bisecting the subinterval to the right until approximation is found for 
the whole interval. 

The number of evaluations increase as we reach higher levels in this scheme. 
Therefore, there is a practical need to restrict the number of levels used. Once the 
maximum number of levels is reached, we can accept the last computed approximation 
and move to the right, or terminate the process in a predetermined manner. The 
accuracy of the values of f(x) determines the accuracy of the value of the integral. 
As we approach higher levels, the lengths of the intervals as well as the magnitudes of 
the corresponding integrals over these intervals decrease, thus resulting in significant 
relative errors. At some point these errors become so large that further refinement 
becomes fatal. But the above adaptive scheme is refined (repeated) only for that 
subinterval where the result does not confirm to the tolerance criterion. This reduces 
the number of levels considerably, and thus this scheme enhances the accuracy of the 
Simpson’s rule. 

The major difficulty in an adaptive process lies in the task of keeping track of 
the stage that has been reached; we should know which subinterval is processed and 
which subinterval is the next one to consider. If the derivatives of / change rapidly in 
some subinterval, we may be required to create a large number of nested subintervals 
before we attain the required accuracy. However, in computer codes there is no such 
difficulty because these codes allow recursion. 

2.10.4. Convergence. Let £ denote the permissible error (tolerance) over 
each subinterval. Thus, if the integral J ^ f(x) dx is computed with tolerance £, 
then a natural choice for tolerance for each if the integrals f ^ a+b ^ 2 f(x) dx and 
f( a +b )/2 d x i s e /2- Thus, as we split further in an adaptive process, the error in 
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a subinterval [a, /?] C [a, b] can be specified by 

VZU)-QiU)\ < 


(2.10.7) 


where Qi(f) denotes the quadrature rule used at the stage of this refinement in the 
subinterval a, /?]. If the rule Qi (/, a, (5) is taken as the final approximate value of the 
integral, then 


[a,P\ 


[a,/3] 


[a,/3] [a,/3] 


This estimate suggests that the separate errors add up to the total allowable error. 
Some of the separate errors may be on the high side, but then the others are on the low 
side, so that their variations eventually cancel out. However, Shampine and Allen 
(1973, p. 72) have noted that “experience suggests that when splitting an interval in 
half, the error allowed be split by roughly 1 / y/2 instead of 1/2, for efficiency’s sake.” 


The absolute error, defined by |/^(/) — Q(f) |, is however not suitable for an 
adaptive code because it depends on the scaling of f(x). Instead, we often use the 
relative error 


W)-QU)\ 

| J a(/)| 


( 2 . 10 . 8 ) 


although it is found to be unsatisfactory in many cases. Let us consider the above 

(Qn + Q12) — Qi 
| (Q11 + Q12) | 

This kind of test is found to be sensitive to computational errors. For example, if the 
values of the function f(x) are large but the value of its integral is small, then we 
may have Qn « — Q 12 , so that the denominator may show severe cancellation and a 
case of overflow. Thus, the errors in Qn and Q12 become more significant, and the 
above test in the adaptive process fails to be reliable. 

Instead of the error (2.10.8), the relative L\ -error test provided by 


< el 


adaptive process. Suppose in the first test we ask: Is 


V b aU)~Q{f) | 
i b a m\) 


(2.10.9) 


is free from the shortcomings of a relative test and can be used with advantage in 
adaptive codes, where the code computes J ^ f(x) dx as well as J ^ \f(x) \ dx. Note 
that if if f(x) is of one sign in the interval [a, b], then the L \-error is the same as 
the relative error. But if f(x) is of an oscillatory type, then f(x) may not be small 
enough, but its integral may be. This error so computed will depend on the absolute 
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value which may not be small, and this may result in some difficult situations while 
using the L\ -error test. 

In order to integrate approximately a given function there are many cases where 
the direct integration may be unreasonable. In such cases we can use the following 
methods and transformations prior to the application of an adaptive computer code. 

1. Split the Interval of Integration. If the function f(x) is discon¬ 
tinuous at a point c E [a, b], we should split the problem of integrating f(x) over 
the interval [a, b] into two integrals J ^ f(x) dx and J^ f(x) dx and use the code to 
compute each integral separately and then add the results. If f'(x) is discontinuous 
at a point c, then we split the adaptive computer code at the point c. 

Example 2.10.2. Let 


f( x ) 


-1 if 0 < a; < 1/3, 
1 if 1/3 < x < 1. 


Then we compute f ^ 3 f(x) dx and f(x) dx separately, and add the t wo results. ■ 

2. Change of Variables. Sometimes a change of variables is required or 
becomes desirable. For example, in the case of the improper integral 


/ f(x) dx , a > 0, 
J a 


( 2 . 10 . 10 ) 


where the interval of integration is infinite, we set x = 1 jt. This changes the integral 


(2.10.10) into f Q a g(t)dt, where a > 0, and g(t) = 


fm 


. Note that the point 


x = oo is mapped onto t = 0 and we have lim g(t) = lim x 2 f(x). 


Example 2.10.3. Consider the integral 


- dx. Set x = 1 jt. Then 


this integral is transformed into 


f 1 e- 1 /* 


dt. Here, t = 0 is an ordinary point for 


g(t) = —-—, since lim^ 0 g(t) = 0- In the particular case when the lower limit of 
integration in (2.10.10) is 0 instead of a > 0, the above transformation does not work, 

f°° f 1 ln£) 

but the transformation t = e~ x does, and we get / f(x)dx= / - - dt = 

./n ./n t 


f{x) dx 


h(t) dt. 


Another case of an improper integral occurs when the integrand becomes infinite 
at some some interior point c of the interval [a, b\. In this case we first split the 
integral at the point c and integrate both parts separately. For example, consider the 

Q ( X ) 

integrand f(x) = --—, where g(x) exists and is nonzero, and 0 < a < 1. We 

\ x ~ c ) 
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set x — c = t@, and choose f3 such that (3(1 — a) = n is a positive integer. Then 

rb r(b-c ) 1/(3 

/o 


f 


g(x) 

(X — c) c 


dx = 


r{b-c) 1/(B 

(3 / g(c + t p ) t^dt. (2.10.11) 

JO 


The integral (2.10.11) is continuous and finite if g is. A particular case is when 
a = m/k, where m and k are integers. Then we set (3 = k and n = k — m > 1, and 

r(b-c) 1/k 

the transformed integral is / g (c + t k ) t k ~ m ~ 1 dt, which is smooth if g is. 

Jo 

Example 2.10.4. Consider 


r 1 e x 

Jo V% 


dx. 


By setting x = t 2 we transform this integral into 


/■ 


2 / e l dt , 


( 2 . 10 . 12 ) 


(2.10.13) 


which can be computed by using a computer code like SIMP with a tolerance of 10“ 5 , 
giving the result as 2.925301. The exact value is 2.92530349, which matches with 
the Mathematica result. ■ 

3. Subtracting out Singularities. We write f(x) as /i(x) + / 2 (t), 
where /i ( x ) is relatively smooth and / 2 (t) contains the awkward part of f(x) which 
can be integrated analytically. Then 

nb nb nb 

/ f(x)dx= / f\{x)dx J r / f 2 {x) dx , (2.10.14) 

J a J a J a 

and integrate the first integral numerically and the second analytically. 

Example 2.10.5. Consider sin y/x dx. The integrand has an infinite deriv¬ 
ative at x = 0. Since sin y/x = y/x for small values of x, we write 

/ sin y/x dx= [ sin y/x — y/x\ dx+ y/x dx , 

Jo Jo Jo 

thus subtracting the ‘singularity’. The first integral is integrated numerically and 
the second analytically. Note that the integrand sin y/x — y/x in the first integral is 
differentiable at x = 0 since 

1 • dr ^ .. COS y/x — 1 

lim — sin y/x — y/x\ = hm-=- = 0. 

dx 1 J 2y/x 


For values close to x = 0 the quantity sin y/x — y/x loses significance as we subtract 
two almost equal quantities. But this is not important since the integrand tends to 
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zero as x —> 0. (The code SIMP applied directly to f(x) = sin yfx with the tolerance 
10 -5 gives the result 0.6023364, with the estimated accuracy of 5 x 10 -7 . The 
correct value of the integral is 2[sin(l) — cos(l)] = 0.6023374. Hence, the true 
accuracy is 10 -6 . The second integral in (2.10.14) computed analytically gives the 
result —0.06432933 with an estimated error of 2 x 10 -8 . Adding these two we get 
the answer 0.6023373, with an estimated accuracy 3 x 10 -8 and a true accuracy of 
1.5 x 10 -7 .) We note in passing that the change of variable x = t 2 transforms this 
integral to f* 21 sin t dt , which gives the result as 0.6023364 by using the code SIMP, 
with an estimated accuracy of 5.2 x 10 -7 and a true accuracy of 1.7 x 10 -8 . ■ 

Another case to be considered is when f(x) can be written as f(x) = S(x) g(x), 
where S(x) behaves badly at c E [a, b], and g(pc) has first n derivatives at c. In this 
case we write 


h(x) = S(x) \g(c) + (x-c) g'(c) + ■ 
h{x) = f(x) - f 2 (x). 


(x — c) r 


9 (n \c) 


Then we can analytically compute the integrals 




(x — c) k 


k\ 


g {k \c)dx , 


and numerically compute the integral 




E 


k =0 


g (fc) (c) 

k\ 


(x 


dx. 


Example 2.10.6. Consider the above example with f(x) = sin where 

x ^siny/x t t . . siny/x ^ ^ „ 

we write j(x) = y/x —and take g[x) = —c = 0, and n = 0. Then 


/ 2 (t) = y/x, and /i (x) = sin yfx — y/x. This splitting is already treated in Example 
2.10.5. If we take n = 1, then we have f 2 (x) = y/x ^1 — and fi(x) = 

sin yfx — f 2 (x). Using the tolerance of 10 -5 the integrand fi(x) gives the integral 
value as 0.002337339 (using SIMP) with the estimated error 1.1 x 10 -7 . The final 
answer is found to be 0.6023374 with an estimated accuracy of 1.8 x 10 9 . ■ 


Example 2.10.7. (Shampine and Allen 1973) Consider the model of a light¬ 
ening rod in the form of an ellipsoidal column that projects above a flat plane in the 
(t, y) -plane with the rod along the £-axis. The potential function is defined by 


rOO 

V(x,y,z) = -z + Az / — 


du 


(a 2 + u) (b 2 + u) (c 2 + uf 


(2.10.15) 
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where A is a constant that depends on the shape of the rod and is given by 


1 

A 


L 


du 


0 yj ( a 2 + u) ( b 2 + u) (c 2 + u ) 3 


and the value of A is the smallest positive root of the equation 

x 2 y 2 z 2 

- 1 --- 1 - 1 = 0 

a 2 + A b 2 + A c 2 + A 

which is found to be 5928.359 (compare with the Mathematica value 5925.37, see 
ex2.10.7. nb on the CD-R). We will compute V at x = 50 = y = z for a = 1,5 = 2, 

c = 100, and A = 5928.359. Note that the integrand 1 yj ( a 2 + u) (b 2 + u) (c 2 + u ) 3 
is well defined since it tends to zero as u —► oo. Thus, we set u = 1/5, which changes 
the integral in (2.10.15) into 


f 1/x _ di _ 

0 t 2 yj(a 2 + 1/5) (5 2 + 1/5) (c 2 + 1/5) 3 


(2.10.16) 


The expression (2.10.16) does not behave nicely for computation, so we rearrange it 
as 



5 

(, a 2 t + 1) (5 2 5 + 1) (c 2 5 + l) 3 


dt. 


(2.10.17) 


Shampine and Allen’s code SIMP with a tolerance of 10 -5 gives the value of this 
integral as 5.705946 x 10 -7 with an estimated accuracy of 6.9 x 10 -7 (compare with 
the Mathematica value 5.70592 x 10 -7 ). The integrand in (2.10.17) is nearly y/t 
near 5 = 0, which gets difficult to integrate because its derivative becomes infinite 
near 5 = 0. Therefore, if we set 5 = w 2 = 1/u in (2.10.17), the integral becomes 


f 1/x 2 w 2 

0 \J(a 2 'up + 1 ) (l)-'ti'- + 1 ) (c 2 w 2 + 1 )' 


: dw , 


which is a bit easier to compute with SIMP, giving the value 5.705914 x 10 -7 with an 
estimated accuracy of 1.8 x 10“ 7 (the Mathematica value for this integral is still the 
same as above 5.70592 x 10 -7 ). To compute the constant A we split the corresponding 
integral as 

r. -run / 

Jo y/(a 2 + u) (b 2 + u) (c 2 + ^) 3 VJo Ja 7 y/(a 2 + ix) (5 2 + u) (c 2 + ^) 3 

which gives the value of 1 /A = 7.788616 x 10 -6 (compare with the Mathematica 
value 7.78868 x 10 -6 ), thus A = 1.283935 x 10 5 (compare with the Mathematica 


2005 by Chapman & Hall/CRC Press 


















2.11. TEST INTEGRALS 


101 


value 1.28391 x 10 5 on the CD-R). Hence, V = —46.337, which compares very well 
with the Mathematica value —46.337, (see ex2.10.7. nb on the CD-R). ■ 


2.11. Test Integrals 


This section provides a list of test integrals which appear in Engels (1980). They 
are useful in testing various quadrature rules. The following notation is used: Let 

n— 1 

F k {x ) = X)(-l) j (i + 1) G k (x) = x~ k \ n = 3.14159; s m (x) = 
3=0 

7tx sin mx h . . 

tan — smlmTTX); t m (x) = — -; Uk m (x) = x smlrruTX); and Vk m(x) 

2 Sill 7 XX 

[mx] x k ~ x , where [x] is the step function. The exact as well as approximate value of 
each integral is presented. 

1. f F\{x) dx = 1 

Jo 

Z. [ F 2 (x)dx = -3/2 

Jo 

3. [ F s (x)dx = 7/3 

Jo 

4. / F 4 (x)dx = -35/12 

5. [ F b (x)dx = 37/10 

. I F 6 (x) dx = -259/60 « -4.316666666666667 
Jo 

. I F 7 (x) dx = 533/105 « 5.076190476190476 
Jo 

. [ Fg(x) dx = -1599/280 « -5.710714285714285 
Jo 

. / F 9 (x) dx = 1627/252 « 6.456349206349207 
Jo 

■. [ F 10 (x) dx = -17897/2520 « -7.101984126984127 

Jo 

. I Fn(x) dx = 18107/2310 « 7.838528138528138 
Jo 


9 

10 , 

11 
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12 . 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20 . 

21 . 

22 . 

23. 

24. 

25. 

26. 

27. 

28. 

29. 


F 12 (x)dx = -235391/27720 « -8.49173881673882 


( F 13 (x) dx = 237371/25740 « 9.22187257187257 
o 


F 14 (x)dx = -1237371/24024 « -9.88057775557776 


F 15 (x) dx = 95549/9009 « 10.6059496059496 


F 16 (x)dx = -1624333/144144 « -11.26882145632146 


F 17 (x)dx = 1632341/136136 « 11.99051683610507 


Fig(x) dx = -31014479/24504485 « -12.65665666033313 


Fig(x) dx = 155685007/11639628 « 13.37542806350856 


I F 20 (x) dx = -155685007/11085360 « -14.04419946668399 
o 

( (10a; - l)(10a; - l.l)(Kte - 1.2)(10a; - 1.3) dx = 1627279/1500 
° « 1085.252666666667 

[ G 3 (x) dx = 5000 - 1/2.42 « 4999.586776859504 
0.01 
fl.l 

I G 4 (x) dx = (1.0(06) - 1 /1.331)/3 « 333333.0828950663 
o.oi 

fi.i 

I G b (x) dx = 2.5(07) - 1/5.8564 « 610.1808091361587 
o.oi 

[ (1 + a;) -1 da; = In2 « 0.6931471805599453 

0 

( (1 + x 2 )- 1 dx = tt/4 « 0.7853981633974483 
0 

( (1 + a; 4 ) -1 dx = (In ^ + ^ + tt) /V32 « 0.866972987339911 


/V32 « 0.866972987339911 


(1 + a; 2 + x 4 )- 1 dx= -+ -= « 1.456205826451164 

L 4 Vl2 

(1.005 + a; 2 ) -1 dx = , 2 tan -1 , 1 « 1.56439644406905 

i VL005 CL005 
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nlO 

30. / 50 (2500x 2 + 1) /tt dx = tan -1 500 /tt « 0.4993638028710166 

Jo 

31. / (a; 2 + lCT fe ) _1 dx = 2 ■ 10 fe/2 tan -1 (l0 fe/2 ) , k = 2(1)6 

29.42255348, k = 2, 

97.3465489, k = 3, 

312.159332, k = 4, 

991.458833, k = 5, 

3139.5926, k = 6, 



32. / (l + 5x 2 ) 1 dx = 


0.5144128009905458 


33. [ (1 + 10a; 2 ) 1 cfe = tan ~ 0.3998760050557662 

Jo v 7 Go 

34. d (1 - 0.5a; 2 )- 1 dx = —U In ( 1 + 

7o 2 V 045 Vi-v/as)/ 

« 1.246450480280461 

35. [' (1 - 0.98*+' = -L= In ( 1 + fg. ) 

Jo 2 VOJ 8 Vi - 3/0.98)7 

« 2.670965314886704 


36. / (l — 0.998a; 2 ) dx = — ■= 

Jo 2+0.1 

« 3.803756514651015 
f 1 2 r 

37. / -;- -7 dx 

J 0 1 + 2 r(x-a ) 2 

( 7r if r = 2, a = 1/2,1/3, 


1 - a/0.998) 


= 1 2< r+2 )/ 2 tan- 1 2( r + 2 )/ 2 if r > 2, a = 1/2,1/3, 

[ 2 r / 2 [tan” 1 (| 2 r / 2 ) + tan” 1 (± 2 r / 2 )] if r > 2, a = 1/2,1/3 

38. f a; 3 / 2 dx = 0.4 


39. [ x 5/2 dx = 2/7 

Jo 


40. 


xdx = 2 k / (l + 2 k ) , A; = 1(1)4 

' 0.666666666666666, k = 1 
0.8, k = 2 

~ | 0.888888888888889, k = 3 
, 0.941176470588235, k = 4 
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x _ [ 0.4647525054, k = 1, 

41. / ^|a; 2 - 0.25| fc dx « i 0.1488716212, fc = 3, 

0 [ 0.06551476837, k = 5. 

/•100 

42. / |d -1//2 dx = 26 


43. [ ^/xdx = 5/6 « 0.833333333333333 
Jo 

44. f 'tyxdx = 10/11 « 0.909090909090909 


\/|a; + 0.51 da; = %/L5 + \/a5/3 « 1.460447131787105 


46. / lx-51“ da; = 


5" +1 + (1 - PY 


for a = 0.1(0.1)0.5, P = Q,\,\ 


47. / \x — f3\ a In \x — f3\dx = --— [(a + 1) In (3 — 1] 

Jo i a + iy 

fora = 0.1(0.1)0.5, a = -0.55(-0.55) - 0.75, /3 = 0, ±, | 

48. [ e x dx = e- 1 « 1.718281828459045 


—-— dx = In -TP— « 0.3798854930417224 
+ 1 e + 1 


e* + 1 


dx « 0.1705573495024382 


/•10 

51. / A/SOe -5071 ’^ c/x = ^ erf(50 sV2jr) 

Jo 


0.5000002111661001 


52. / 25 e _25x = 1 


53. J (e~ x - e~ wx ) dx = 0.9 + 0.1 e“ lu - e _1 

° « 0.5321250988215339 

54. [ 2 (e ~ 9x2 + e- 1024 ^- 0 - 25 ^) f ^dx = 1/16 + erf(3)/3 


0.3958259698343338 


55. / \vtxdx = 10 In 10 ~ 14.02585092994046 
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56. 

57. 

58. 

59. 

60. 

61. 

62. 

63. 

64. 

65. 

66 . 

67. 

68 . 

69. 

70. 

71. 

72. 


/ In x • sin x dx = In 10 4 cos 10 4 — In 7 cos 7 
J io- 4 

+Ci (10- 4 ) - Ci(7) « -1.967546385989968 

[ (2 X x ) / (2* - 1) dx « 1.711857371268652 
Jo 

/ sin(7rx) dx = 2 /tv ^ 0.6366197723675814 
Jo 

/ cos X dx = sin 1 « 0.841470984807897 
Jo 

/ 2/ (2 + sin(107rx)) dx = 2/\/3 « 1.154700538379252 
Jo 

,27T 

/ x sin(30x) cos x dx = —607r/899 « —0.2096724796611653 
Jo 

,27T 

/ a; sin(30a;) cos(50a;) da; = 3 tt/80 « 0.1178097245096172 

Jo 

p2tv 

/ (tvx sin(30x)) / \JAtv 2 — x 2 dx = tv 3 J\ (607t) 

° « -1.271629809446774 

J (0.92 cosh x — cos x) dx = 0.92(e — 1/e) — 2 sin 1 
/ sin(1007rx)< 

Jo 

,1/3 

/ (1/x) sin(l/x) dx = Si(20) - Si(3) « -0.3004108269560286 

J 1/20 

/ Sl(x)< 

Jo 

/ s 2 (x)< 

Jo 

/ s 3 (x)< 

Jo 

/ s 4 (x)< 

Jo 

[ t 2 (x)< 

Jo 

[ t 3 (x)i 

Jo 


0.4794282266888015 
I dx = 0 


I dx = 1 


I dx = — 1 


I dx = 1 


I dx = — 1 


l dx = 0 


l dx = 1 
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dx = 0 


73. f t<±(x) 

Jo 

74. / uo,m (t) dx = 2 / (tyitt ), m = 5 , 15 , 25 

7o 


■S' 

Jo 


0.1273239544735163, m = 5 
0.04244131815783875, m = 15 
0.02546479089470326, m = 25 


= 0 , m = 10 , 20 


.(x) dx = l/(m7r), m = 5,15, 25 


77. J ui, m (x) dx = — l/(m7r), m = 10, 20 

° -0.03183098861837907, m = 10 


< 


-0.01591549430918954, m = 20 

78. f U 2 ,m(x) dx = l/(m7r) — 4/(m7r) 3 , m = 5,15, 25 
7o 

' 0.06262992813489575, m = 5 
0.02118243503810966, m = 15 
0.01272413905453673, m = 25 

x y 

79. J U2,m(x) dx = — l/(m7r), rn = 10, 20 

° -0.03183098861837907, m = 10 

-0.01591549430918954, m = 20 


Jo 


80. I U3 jrn (%) dx = l/(m7r) — 6/(m7r) , m = 5,15, 25 

/o 

' 0.06211390358396455, m = 5 


< 


0.0211633230177048, m = 15 
0.01272001085812928, m = 25 


i. 

Jo 


81. J U3, m (x) dx = 6/(m7r) 3 — l/(m7r), m = 10, 20 

° -0.03163747941177987, m = 10 

-0.01589130565836463, m = 20 

82. J (sech 2 (10a; — 2) + sech 4 (100a; — 40) + sech 6 ( 1000a; — 600)) dx 

° = (tanh8 + tanh2)/10 +2/150+ 2/1875 
« 0.2108027549615858 
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83. 

84. 

85. 

86 . 

87. 


89. 

90. 

91. 

92. 

93. 


94. 

95. 

96. 


/ Tl | 1 

/ vo ,™(t) dx = \ n l n (-), m = 5(5)25 

Jo ’ \ n / 

i: 

L 

i: 


n =1 
771 — 1 

vi,m(%)dx =—-—, m = 5(5)25 

1 / N 7 4777 2 — 3777 — 1 , s 

1^2 mix) dx = - — -, 777 = 5(5)25 

’ 12777 


(x + k) dx = 1.5 for k /3 < x < (k + l)/3, k = 0(1)2 


/To, 

/'{/ 
f {T 

/T 

/'{l 


0.49 < x < 0.5, 

1000 ( x — x 2 ) , otherwise 

= 1000 (0.49 2 /2 - 0.49 3 /3 + 1/12) « 164.167 
r 1 [ l/(x + 2), 0 < x < e-2, 

e-2 <x < 1 
0.3068528194400547 
0 < x < 0.3, 

0.3 < x < 1 

x — 0, 

0 < x < 1 

x = 0, 

r/ (e x — 1), 0 < x < 1 

f 1 f 100, x = 0, 

Jo l sin(1007rx)/x, 0 < x < 1 

« 0.00909864525656933 

-1 f 50, X = 0, 

/ \ sin 2 (507fx) 

7 o 


dx 


dx = 1 — In 2 

dx = 0.7 

dx = 2 

dx « 0.777504635 
dx = (Si(1007r) — Si(107r)) /dr 


/•■ro, 

Jo l In a;, 


50(7hr) 2 
0.498987230169528 

0 < x < 10" 15 , 


Si(1007r) | cos(1007r) — 1 
0 < x < 1 7T 


10“ 15 < a; < 1 
—1 < x < 0, 


100(tt) 2 


dx = 10 -15 - 1 + 15 • 10" 15 In 10 
« -0.999999999999965 


I-i { e l ~ x , 0<x<2 
1.5 ( „10x 


dx = 1 + e - 2/e « 2.98252294611616 

f lb f e Wx , -l<x< 0.5, . «. _ in . , 

/ \ inn i dx = ( 2e 5 + e — e )/10 

y_! 1 e 10 ^-*), 0.5 < X <1.5 v " 


29.68330107522225 
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Gaussian Quadrature 


The interpolatory quadrature rules are based on the notion that the nodes (quadrature 
points) must be preassigned equidistantly or with some other kind of fixed distribution. 
As mentioned in Kowalewski (1932), Gauss was the first to realize that a suitable 
variation of the nodes leads to better accuracy in general, and this fundamental result 
of Gauss started many variations and generalizations of the Gaussian formulas of the 
type Ia(f) = Y^k= o w k f (), where the weights Wk are positive zeros of certain 
orthogonal polynomials and the nodes xk are distinct points in the interval (—1,1). 
We will study some extended Gaussian rules and provide tables of their nodes and 
weights. Gaussian moments are discussed in detail and presented in a tabular form. 
The optimal Gaussian rule of the highest degree of precision is presented. 


3.1. Gaussian Rules 

Let {c j) n (x )} denote a sequence of polynomials, where c/) n (x) G V n . These polyno¬ 
mials are orthogonal with respect to a weight function w(x) over the interval [a, b\. 
We can write 4> n (x) = &n Pn(%)> where a n ^ 0 is the coefficient of x n in 4> n (x), and 
p n (x) is an orthogonal polynomial. Then, we have 

f w(x) cj)i(x)(j)j(x) dx = 0 for i^j. (3.1.1) 

J a 


The Christoffel-Darboux identity is 


E 


k =o 


7 k 


^n+l (x) ^nix) ^n+1 (.U) 

a n In (x - y) 


(3.1.2) 


108 
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w(x) 4>\{x) dx. 


(3.1.3) 


Now, set y = Xi, where Xi are the zeros of 0 n (x). Then we get 

0&( x ) 0fc ( x i ) _ 4>n( x ) 0n+1 ( x i) 

“ Ik a n 7 n {x — Xi) 


(3.1.4) 


Now, we multiply both sides of (3.1.4) by w(x)<j)o(x) and integrate over [a, b\. Then 
using (3.1.1) we get 


00 (Xi) = - 


0n+1 \ x i 


x n in Ja 




Since from the definition of the Lagrangian interpolation polynomial we have 
. , , n n {x) 4> n (x) 


(x — Xi) 7r' n (x^ (x — x i )(f) , n {xi 

and since 0q(x) = const, we find from (3.1.5) and (3.1.6) that 

i = - 0ra+1 (Xi) [ b w ( x) M?l dx 


In J a 

0n+1 ( x i ) 0n (^G 


0n+l (Xi) (t)' n (Xi) 


w(x) U(x) dx 


(3.1.6) 


(3.1.7) 


O^n+lTn r- • -i 

w i =--- for i = 1,... , n. 

a n 0n+1 \ x i ) 0^ 0G) 


The error is given by 




Note that for the Legendre polynomials P n {pc) these formulas give 


= jpHx)dx=- 


2ti 1 


(3.1.8) 


(3.1.9) 


n 2 n (n!) 2 ’ 

2 

Wo =- 

(n + 1) P n+ 1 (xj) ££ (a;,) ’ 

2 2 ” +1 (n!) 4 (2n) , < . 

n (2n +1) [(2n)!] 3 ^ ' 


(3.1.10) 
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We consider quadrature rules of the form 

/ b n 

f(x)dx = J2 w if (Xi) , (3.1.11) 

i=0 

where the nodes (abscissae) Xi are not equally spaced. If we replace / by an inter¬ 
polating polynomial p n (x) constructed at the points i = 0,1,... , n, then this 
polynomial has the Lagrangian form 


Pn(x) = lo(x)f (x 0 ) H-h l n {x)f ( X n ), (3.1.12) 


where U{x), i = 0,1,... , n, are defined by (1.4.3). If we integrate (3.1.12) over 
a < x < b, we obtain the right side of (3.1.11), where the weights are given by 

Wi = f li(x) dx , 0 < i < n, (3.1.13) 

J a 

Note that for equally-spaced nodes Xi this procedure leads to a different method of 
deriving the Newton-Cotes quadrature formulas. The error term (1.4.5) on integration 
over the interval [a, b] gives 


n i pb 

Inf ~^ w if (Xi) = ( - n + 1 ^, J 'Xn+l (x)f (n+1) 


E 

;=o 


(0 dx, 


(3.1.14) 


where 7r n+ i(x) = (x — x$) (x — x\)... (x — x n ). Thus, the quadrature rule (3.1.11) 
is exact if / E V n because since f {n+1 \x) = 0 the right side of (3.1.14) vanishes. 
The rule (3.1.11) is exact for any linear combination of functions / and g if it is exact 
for the functions / and g separately. Thus, if a and (3 are any arbitrary real numbers, 
we have 

pb n 

/ (af(x) +/3g(x)) dx = I b J + I b a g = [a f (a^) + (3g {xf) ]. 

J a i =0 

This shows that the rule (3.1.11) is exact for / E V n if it is exact for the monomials 
1, x, x 2 ,..., x n . In fact, the rule (3.1.11) is exact for if 



(3.1.15) 


Since the left side of (3.1.15) is known, we take j = 0,1,... , 2n + 1 and obtain a 
system of (2 n + 2) equations to solve 2n + 2 unknowns Wi and x^ for i = 0,1,... , n. 
If this system has a solution, the resulting quadrature rule will be exact for / £ T^n+i • 
In fact, Pj(x)pk(x) £ V 2 n+i for j, k < n, so that 


n 

E wi Pj P k 

i =0 


(Xi) = / w(x) pj(x)pk(x) dx = Sjk- 
J a 
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Thus, 


(f,g) = ^Wif{xi)g{xi). 


i =0 


We will develop the error (3.1.14) in terms of the divided differences. Since 
f(x) ~Pn(x) = n n +i{x)f [x,x 0 ,... ,x n ], 


we have 


b j-J2 w ‘ 

i =0 


f(xi)= / Tr n+ i{x)f[x,x 0 ,. 

J a 


dx. 


(3.1.16) 


If / [a;, xo,-.- , x n \ € V m , m > 0 , then / [x, x 0 ,... , x k +i] € V m -i- This result 
follows from (1.3.7) which gives 


f[x,X 0 ,... ,x k+1 ] 


f[x 0 ,.. • , X k+1 \ - f [x, X 0 , ■ ■ ■ ,x k \ 
x k +l - X 


and since the numerator on the right side is a polynomial of degree m and has 
(x — Xk+i) as one of the factors, then / G V m -\. Hence, if / G we can 

show by induction that / [x, xo ,... , x n \ G V n . Now, let {po,Pi, • • • , Pn+i } be 
a set of orthogonal polynomials on a, 6 ], and let p r G V r , r = 0,l,...,n + l. 
Then for some set of real numbers qq? • • • , we have / [x, xo,... , x n \ = 
no Po (x) + aipi(x) -\ - \-a n p n (x) . Then, because of the orthogonality relations 


L 


b 


p r (x) p s (x) dx 


= 0 for r 7 ^ 5 , 
7 ^ 0 for r = 5 , 


the right side of (3.1.16) is zero if 7 r n+ i (x) = ap n+ 1 (x) for some real a^O. 

The Gaussian quadrature rules cannot in general be used for functions that are 
defined only at discrete points since such rules require that the functions be evaluated 
at specific points ^ which are the zeros of the related polynomials. However, in 
some experimental cases where there is complete freedom of choosing the data of 
functional values at the specific nodes ^, the corresponding Gaussian rules can be used 
to evaluate 7^(/). The error bounds are virtually impossible to obtain in such cases. 
But if the data is mostly error free, then a very high order interpolating polynomial 
may be effectively used to obtain a significantly accurate result. There is no practical 
advantage in using a Gaussian quadrature if the data is noisy and some smoothing is 
needed prior to the application of a specific Gaussian quadrature rule. 

It must be noted that the Gaussian rules of all orders are also Riemann sums. 
These rules integrate exactly polynomials of any degree by a formula of the form 
(3.1.11). 
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3.2. Extended Gaussian Rules 

The extended (repeated or compound) Gaussian rules are similar to the repeated 
trapezoidal, midpoint and Simpson’s rules. If / e C 2n+2 [— 1,1], the (n + l)-point 
Gaussian rule is of the form (3.1.11), where the error is given by 

£ --A»F /<2 " +2)k) - {e( - 1 ’ 1) - (3 ' 2 ' 1) 

This error decreases rapidly as n increases. 

Theorem 3.2.1. Ifp 2n+ i(x) E P 2n+ i,then the formula 

/ b n 

w{x)p 2n +\{x)dx = N a i P2n+1 (%i) 
i =0 

is exact if the points Xi, i = 0,1,... , n, are the zeros of the orthogonal polynomial 
0 n+ 1 (x), and ai are defined by 


f b 

ai= w(x)li(x)dx. 

J a 

Proof. The polynomial p 2 n+i {%) can be written in the form 
P2n+i(x) = q(x) <j>n+i(x) + r{x), 

where q(pc) and r(x) are polynomials of degree at most n. Since Xi are the zeros of 
0 n+ 1 (x), we get P 2 n+i (xi) = r (x^) for i = 0,1,... , n. Also, since the quadrature 
rule 

nb nb n 

I b aU) = / w(x) f{x)dx = / w(x)p n {x)dx = 'Y^a i f i =I n {f) 

J a J a -_ n 


is precise for n, we have 


pb n 

/ w(x) r(x) dx = aj r (xj ). 

^ a i =0 


Now, consider 


rb rb 

la (P 2 n+i) = / w(x)p 2n +i{x) dx= w(x) [q(x) <j> n +i{x) + r(x)] dx 
J a J a 

pb pb 

= / w(x) q(x) cj) n +i(x) dx + / w(x)r(x) dx. 

J a J a 
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We can replace q(x) by its unique representation in terms of the orthogonal polyno- 

n 

mials 4>i(x), i = 0,1,... , n;i.e.,g(x) = Ci4>i(x). Then the first term on the right 

i=0 

side in /p 2 n+i becomes automatically zero because of the orthogonality relations of 
4>i(x). Thus, 

n n 

lt(P 2 n+l)= / w(x)r(x)dx = '^2a i r(x i ) = '^2a i p 2 n+l{x i ) = InP 2 n+l, 

'' a i=0 i=0 


where cu > 0 denotes the weights. ■ 

Theorem 3.2.2. (Johnson and Riess 1977, p. 326) The Gaussian quadrature 
formula has precision 2n + 1 only if the points Xi, i = 0,1,... , n, are the zeros of 

0n+1 (t) . 

Theorem 3.2.3. Let f(x) G C 2n+2 [a,fr]. Then the error in using the Gaussian 
quadrature is given by 

ilU) ~ InU) = / ( ( 2 2 " + + 2) 2 ( ) ? l W ( X ) U+lW dx, 


where T n (x) is the Chebyshev polynomial of the first kind. 

3.2.1. Gauss-Jacobi Rule. The Jacobi polynomials Pn a,f3 \x ) are the 
orthogonal polynomials with the weight function w(x) = (1 — x) a (l-\-x)P, a > —1, 
(3 > — 1. The Gauss-Jacobi rule (also known as the Mehler quadrature formula) is 
defined by 

r*l 

(1 — x) a (l + x)P f(x) dx = ^ Wi f (xi) + E, (3.2.2) 


/:< 


2=1 


where 


2ti T o T f3 T 2 T(n T o T l)r(7i T f3 T 1) 
n + a + /? + 1 (n + 1)! T(n + a + /? + 1) 


2«+/3 




and the error term E n in the n-point rule is 

T(n + a + l)r(n + (3 + l)r(n + « + /? + !) 


En = 


(2n + a + j3 + 1) [I\2n + a + [3 + l)] 2 

Til 2 2n + a +/ 3 + 1 


(3.2.3) 


x 


(2n)\ 


f {2n) (0, ^e(-l,l). (3.2.4) 


The Gauss-Legendre rule is a special case of formula (3.2.3) with a = /? = 0. The 
Gauss-Chebyshev rule is another special case with a = (3 = — 1/2. 
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For integrands with the Jacobi weight function w(x) = (1 — x) a (l + x)@ Piessens 
and Branders (1973) use the formulas 

r i n 

/ (1 -x) a (l + x) l3 g(x)dx ss ’Y^b k Gk(a,j3) + £+ (3.2.5) 

•'~ 1 k =o 


-i l-i- N 

/ (1 - x) a (l + a+ In (——^) g{x) dx^^bu I k (a, 0) 

J — 1 U — Ci 


+ 


fc=o (3.2.6) 

where g(x) is assumed to have a rapidly convergent Chebyshev series expansion 


g(x) = ^ a k T k(x ), 


k =0 


and 


N 


bk — -at ^ ^ 9 ip^m) T k (Xm) i %m — COS , 


m =0 


n, —n, <+ + 1 
i, Q + /? + 2 ’ 


/-* / m _ oa+0+1 r ( a + MO? + 1) p 

G ” ( “’ /?) - 2 r(a + /3 + 2 ) ^ 

~ a fc+i (Gfe+i(a, P) — /?)), 

El « a fc+ i (4 + i (a, /?) - 4-i (a, /?)), 

and 7 n (a, /?) are obtained from the recurrence relation 

(n + (3 + n + 2) 4+i( ck, /?) + 2(a — /?) 4(^5 /?) + (n + (3 — tl + 2) 4 —1 (ce /?) 

= 2G n (a,(3) — G n _i(a,/?) — G n +i(a,/?). 


Example 3.2.1. Compute 


J (1 - 2+ /2 (l + 2+ /2 5+) cte, i = 1,2, 


where 


gi(x) = e 2x , and ^(t) = (x + 1.01) 3//2 . The results are given in Table 3.2.1 
(Piessens and Branders 1973). 


Table 3.2.1. Exact Values and Absolute Errors. 



Exact 

N 

Gauss-Jacobi 

Formula (3.2.5)-(3.2.6) 

9\{x) 

2.1643953820 

5 

7.9(—7) 

1.8(-6) 



6 

6.0(—9) 

7.2(—8) 

92{x) 

4.2785147337 

10 

2.7(—1) 

2.5(-l) 



20 

2.3(—2) 

2.6(—1) 



50 

8-l(—6) 

9.3(—6) 



100 

< 5.0(—11) 

< 5.0(—11) 
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The value of these two integrals are I\ (2) « 2.4985665285 and 5.7963478953, 
respectively (by Mathematica), which casts doubt about the accuracy of the above 
method. 


3.2.2. Gauss-Legendre Rule. This rule is a special case of the Gauss- 
Jacobi formula (3.2.3) with a = (3 = 0. The weight function w(x) = 1 and the 
orthogonal polynomials (j>i{pc) are the Legendre polynomials Pi(x),i = 1,..., with 
Pi( 1) = 1. This rule on the interval [—1,1] is given by (3.1.11), where the nodes Xi 


are the z-th zeros of P n (x); the weights are given by Wi 
the remainder is 


2 

(! - A) l p n ( x i )} 2 


; and 


R 


n 


2 2n+1 (n !) 4 
( 2 n+ l)[( 2 n )!] 3 


/ (2n) (A 


1 < £ < 1 . 


The Gauss-Legendre rule for arbitrary interval [a, b] is 


pb 7 _ n 

/ / (y) dy = —— 1 Wi f (i/i) + R n 

J a ^ •_-) 


where the nodes are t/j = ( ——— ) -7’ i - 
Wi are defined above; and 

(b - a) 2n+1 2 2n+1 (n !) 4 


Rn = 


( 2 n + l)[( 2 n )!] 3 


; the related nodes Xi and the weights 


AN A a<i<b. 


The rules (3.1.11) are exact for / e V 2 n+ 1 - 

Using the first few Legendre polynomials Po(x) = l,Pi = x, P 2 = (3x 2 — l) / 2 , 
P 3 = (5x 3 — 3x) /2, we get 

For n = 0 in (3.1.11) we have the Gauss-Legendre rule with one node at x = 0 
which is the zero of P\(x)\ 7ii/ = 2/(0), which is exact for f E V 1 . This is 
comparable to the midpoint rule. 

For n = 1 in (3.1.11) we have the Gauss-Legendre rule with two nodes at x = 
±l/\/3 which are the zeros of P 2 (x): I x _ x f = / (—1/\/3) + / (l/x/3), which is 
exact for f EV 3 . This is comparable to the Simpson’s rule. 

For n = 2 in (3.1.11) we have the Gauss-Legendre rule with three nodes at 
x = 0 , Ty/3/5 which are the zeros of P$(x): /Ii/ = [5/ ^—^3/5^ + 8 /( 0 ) + 

5/ ^^3/5^ ] /9, which is exact for / E P 5 . 

The weights and nodes of the Gauss-Legendre rules for small n = 1(1)5 are as 
follows: 
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n = 1 : x\ = 0, w\ =2; 

n = 2 : Xi = — £2 = l/\/3, ur = ^2 = 1; 

n = 3 : xi = — £3 = ^/3/5, X 2 =0, w\ = ws = 5/9, W 2 = 8/9; 

n = 4: x l!2 = -x 4t3 =[(3±VX8) /7] 1/2 , w 1)2 = w 4 , 3 = (l Tx /5754)/2; 

n = 5 : X 12 = —£ 5,4 = (5 ± \pXX[7 ) 1 / 2 /3, x 3 = 0, 

1171,2 =^ 5,4 = (3.22 =F 1.3 VoJ)/9, w 3 = 64/225. 

n 

The following two properties are obvious: (i) = 2; and (ii) this rule is 

i=0 

symmetric with respect to the point £ = 0, i.e., if (£^, wi) belongs to the rule, so does 

For larger values of n the nodes and the weights are given in Table A .6 for n = 
2(1)10,12,16. The files gausspts4-6 .nb, gaussptsl 2 .nb, gaussptsl3 .nb, 
GaussLegendre. m and GaussLegendre. nb on the CD-R are useful. Since this data 
is part of computational codes, these values are either incorporated in the codes or 
are generated to any degree required by the program incorporated in the codes. The 
Gauss-Legendre rules are mostly used in computer subroutines, because they have 
the highest possible degree of precision. The weights and nodes are generally floating 
point numbers. But the closed form of the nodes and weights for this quadrature for 
small n = 1(1)5 is very suitable for applications on electronic pocket computers 
where there is no storage for long floating point numbers. These nodes and weights 
are given below. 

For the Gauss-Legendre rule, an interval [a, b\ can be transformed into [—1,1] by 
using the linear transformation 


a = 


b T a 
2 + 


b — a 
2 


Then the Gauss-Legendre quadrature rule becomes 


if = h —Y L '^rw k f(z >k ). 

k=1 


(3.2.7) 


(3.2.8) 


where the nodes Xk are the n zeros of the n-th degree Legendre polynomials. 

rir/2 

Example 3.2.2. (Hornbeck 1975, p. 156) Evaluate / x 2 cos x dx by using 

Jo 

the Gauss-Legendre quadrature with n = 4. The following table of nodes and weights 
for n = 4 will be used. 


6c 


±0.3399810436 

0.6521451549 

±0.8611363116 

0.3478548451 
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7r 

Since Xi = — (1 + &), we get 

Xi = 1 (1 - 0.8611363116) = 0.109063286, 

* 2 = J(l-0.3399810436) = 0.518377676, 
a ; 3 = 1 (1 + 0.3399810436) = 1.05241865, 

*4 = 1(1 + 0.8611363116) = 1.46173304, 

which gives 

/ (xi) = x\ cos X\ = 0.011824127, / (x^) = £2 cos £2 = 0.233412695, 

/ (£ 3 ) = x\ cos £3 = 0.548776921, / (£ 4 ) = £4 cos £4 = 0.232569839. 

Thus, 

1 = yy J2 w if U) 

2=1 

7T 

= 4 [ W 1 / (^l) + ^2 / (2:2) + ^3 / (2:3) + W 4 f (*4) ] 

= 1 [(0.3478548451) (0.011824127) + (0.6521451549)(0.233412695) 

+ (0.6521451549) (0.548776921) + (0.3478548451) (0.232569839)] 

= 0.467402. 

This result is compared with the trapezoidal rule (n = 3), Simpson’s rule (n = 4), 
and the exact solutions in Table 3.2.2. It is found that the Gauss-Legendre result 
is remarkably accurate with only 4 nodes. Note that both Gauss-Legendre and the 
trapezoidal rules involve 4 evaluations of f(x) whereas the Simpson’s rule requires 
5 evaluations. ■ 

Table 3.2.2. 

Gauss-Legendre Trapezoidal (n = 3) Simpson’s (4 = 4) Exact 
0.467402 0.411411 0.46689 0.467401 


Example 3.2.3. (Ralston-Rabinowitz 1978, p. 117.) Compute 
n = 1 and h = 1. We have 


dx 

x 


with 



1 

2 


l 

E 

i=0 


= 1.097713. 
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The error is bounded by 0.000046 


11 1 

90 (3)5 < 2 < 90 


0 . 011111 . - 


3.2.3. Gauss-Laguerre Rule. A Gaussian quadrature over the interval 
[0, oo) with weight function w{x) = e~ x (Abramowitz and Stegun 1968, p. 890). The 
abscissae for quadrature order n are given by the roots of the Laguerre polynomials 
L n (x). The weights are 


w, = - 


A n -\-\ Tn 


7n-l 


A n L f n {xi) L n - i-i {%i) A n —\ L n _\ ( Xi ) L f n ( 27 ) 


where A n is the coefficient of x n in L n (x), given by A n = 

1 . 'tt-n r . ^ pOO / x r -r / \-|2 


(-ir 


Thus, 


ln+1 


, and ^ n = — —. Also, 7 n = J 0 °° w(x) [L n (x)] z dx = 1, which gives 

71 T 1 71 


1 1 

V0' = - =- 

(n + i) l' n (Xi) L n+ 1 (xi) n i n _i (a;*) L' n (x^) 

_ 1 _ _ Xi _ 

Xi [L' n (Xi )] 2 (n + l ) 2 [L n+ 1 (Xi )] 2 
The error term is given by 


E„ 


(» 0 2 

(2ti)! 


f {2n) (0 • 


The nodes and weights for the Gauss-Laguerre rule are given in Table A.7 for n = 
2,4, 8 ,10. For n = 2 they have the exact values 


7i = 2 : 


Xi — 2- V2, 
= 2 + \/ 2 , 


Wi = (2 + v/2)/4, 
= (2 - \/2)/4. 


3.2.4. Gauss-Hermite Rule. This is a Gaussian quadrature over the interval 
(—oo, oo) (Abramowitz and Stegun 1968, p. 890). The nodes for quadrature of 
order n are given by the roots of the Hermite polynomials H n (x), which occur 
symmetrically about 0. The weights are 

A n -\- 1 7n A n 7n— 1 

V0' —— -= - - 

An (^7) -^n+l (Ai) A n — i H n —1 {%i) -^n (^7) 

where A n is the coefficient of x n in H n (x). For Hermite polynomials, A n = 2 n , so 
^ +1 = 2. Additionally, 7 n = ypH 2 n ti !, so (see Abramowitz and Stegun 1968, p. 

■An 

890) 

2 n+1 7i! 2 n (ti — 1)! ^/tt 

W% H n+ 1 (x^ H' n (x^ H n -1 (x^ H' n (x^ 

2 n+1 ti ! yAr 2 n+1 ti ! yJH 2 n_1 ti ! ^ 

[H' n {xi)} 2 [H n+1 (xi)] 2 n 2 [H n _i(xi)} 2 ' 
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where the following recurrence relation is used: H' n (x) = 2n H n -\(x) = 2 x H n (x) — 
H n+ 1 (pc). The error term is 


Er, 


Tl\ y/lT 

2 n (2 n)\ 


/ (2n) (0- 


The nodes and weights can be computed analytically for small n as: 


n = 2 : 
n = 3 : 


n = 4 : 


Xi = ±1 / V2, 

Xi = 0 , 

Xi = ±\ \/ 6 , 


Xi = ±t 


I3-V& 


Xi = ±t 


I 3 -V 6 


Wi = \ 

Wi = | UF, 

Wi = a/tF/6, 

Wl 4(3 -Vey 


Ws = —;- 

4(3 + x/ 6 ) 


The nodes and the weights for the Gauss-Hermite rule are given in Table A.8 for 
n = 2,4,8,16. 


3.2.5. Gauss-Radau Rule. A Gaussian quadrature-like formula for numer¬ 
ical estimation of integrals. It requires m +1 points and fits all polynomials to degree 
2m, so it effectively fits exactly all polynomials of degree 2m — 1. It uses a weight 
function w(x) = 1 in which the endpoint —1 in the interval [— 1 , 1 ] is included in a 
total of n abscissae, giving r — n — 1 free abscissae. The general formula is 



2 ^ 

dx = -2 /(-1) +y»i/(.'•;) . 
n z 

i =2 


The free nodes for % = 2,... , n are the roots of the polynomial ^ n E n (x) ^ 

1 T x 

where P n (x) is a Legendre polynomial. The weights of the free nodes are 

1 ~Xi 1 


Wi = 


n 2 [P n -1 (a;*)] (1 - x*) [P^_j (xj)] 


2 * 


The error term is given by 

22n—1 


1 ( :V !| /l2 "~ ll(0 ' - 1<{<L 
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The nodes and weights are given in Table A.9 for n = 3(1)10; for smaller values of 
n their exact values are 


n = 2 : 

Xi = -1, 


Wi = 



1 


3 



3’ 


2’ 


n = 3 : 

Xi = -1, 


Wi = §, 



= 1(1- 

v'e), 

1 

18 

(l6 + \T) 



Ve), 

1 

18 

(l6-\/6) 


For nodes and weights, see radou. nb on the CD-R. 

3.2.6. Gauss-Lobatto Rule. When the Gaussian formula (3.1.11) is used 
with the polynomials K- l(A where P n (x) are the Legendre polynomials, we get 
Lobatto’s rule: 

/ I n -1 

f(x) dx = — -— [/(1) + /(-1)] + Wi f ( x i ) + 

-i n{n-l) 


where the quadrature point Xi is the (i — l)-st zero of P^_ 1 (x); this formula is exact 

2 

if f e P 2 n-i, and the weights Wi = _ - T ^\2 for x, ^ ±1; and 

n[n -tJu n— l \%i) \ 


= ~ n ( n — l) 3 2 2n ~ 1 [(2n — l)!] 4 (2n _ 2) 

(2n — l)[(2n — 2)!] 3 1 


-1 < £ < 1 . 


The 3-point Lobatto rule is Simpson’s rule. The nodes and weights are given in Table 
A. 10 for n = 3(1)10. For nodes and weights, see lobatto .nb on the CD-R. 

3.2.7. Gauss- Che by shev Rule. In the quadrature rule 


/ b n 

w(x) f(x) dx = ^ Wi f (Xi), 

i =0 


(3.2.9) 


the weight Wi and the nodes Xi can be found for different orthogonal polynomials 
approximations of f(pc) such that formula (3.2.9) is exact for all / E V^n-x i- Thus, 

in particular, if [a, b] is taken as [—1,1] and w(x) = (1 — x 2 ) , the orthogonal 

polynomials are the Chebyshev polynomials Tjy(x) of the first kind, and the resulting 
formulas are known as the Gauss-Chebyshev rule. Thus, by taking the interpolating 
polynomials as 

n 

Pn(x) = Y J lX)f{x i ) , 
i =0 
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where Xi are the zeros of T n (x). Then, in view of (3.2.3) the weights Wi are given by 


Wi = 


7T 

Tn +1 ( x i) 


(3.2.10) 


ti sin tlO 

Putting x = cos 6 , we have T n (x) = cos nQ, and T'(x) = — ; ——. Now we write 

sm 0 

Xi = cos 6i. Then 


T n+ 1 (x^ = cos(n + 1 )6i = cos nOi cos6^ — sin nOi sin^ 
= =p^l — xf, since cos n6i = 0, 

n cin n 0 ■ -A-m 

A (A = 


sin 0 7 - 




which gives 

w* = -. (3.2.11) 

n 

This shows that for all Chebyshev rules the weights are all equal. The error in the 
n-point rule is given by 

9tt 

E ’- = ¥^yJ an>{0 ’ - < « <L < 3 - 2 - 12 > 


We choose [a, b] = [—1,1], w(x) = (l 
the normalized Chebyshev polynomials 


— x 2 ) 


- 1/2 


, and the polynomials qi (x) as 


Qi 0 ) = < 


2 

— Ti(x) for i = 1, 2,... , n — 1, 

7T 


— To(x) for i = 0. 

7T 


(3.2.13) 


The nodes ^ for the n-point quadrature are the zeros of T n (x), defined by 

6 = cos * = 1,2, ...,n. (3.2.14) 

The rule with ^ given by (3.2.14) and the weight (3.2.10) is of degree 2 n — 1, and 
is known as the open Gauss-Chebyshev rule , since the endpoints are not included 
as the nodes. The word ‘open’ is generally omitted since all Gaussian rules with 
positive weight function are of the open type. This rule is also known as Fejer’s first 
integration formula 


r 1 n / 

/ / (x) dx = Wi fy 

J- 1 i = 1 


COS 


(2 i — 1)7T 
2 n 


) > / C V n -i, 


(3.2.15) 
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where the weights Wi are given by 


2 

Wi = — 

7r 


H 2 ] 




cos (2k 9k) 


k=1 


4/c 2 - 1 


(3.2.16) 


The (open) Gauss-Chebyshev rule is related to the midpoint rule with w(x) = 1, 
which is defined by 


i>j* h £f( a + &L-W), h = b —±. 

2 = 1 

This is easily seen by setting [a, 6 ] = [0, tt] and x = cos 0; then the above midpoint 
rule changes to 


1 / (cos 1 x) 

J \ ; dx 

-1 \/l — T 2 


1 V' ,/ (2i - 1)7T \ 
n V 2n / 


We can, however, construct the ‘closed’ Gauss-Chebyshev rule by including the 
endpoints £o = 1 and £ n = — 1 as additional nodes. Then we get a rule with nodes 
= cos(z7r/n), z = 0,1,... , n, and weights = 7r/n for z = 1,2 ,... ,1V, and 
wq = w n = 7 t/(2 n). Thus, the ‘closed’ Gauss-Chebyshev rule is 



vTT? 


dx 



(3.2.17) 


This rule can be obtained from the repeated trapezoidal rule by the same method as 
used in showing the relationship of the open Gauss-Chebyshev rule to the midpoint 
rule, although the relation does not clarify why the rule is of high degree. In practice 
we do not generally use the closed rule because sometimes it is not possible to include 
the endpoint nodes. However, the closed rule has the advantage in a situation where 
we carry out a sequence of computations by successively doubling n, because in the 
closed rule the n points ^ are the subset of the 2 n points and the previous function 
evaluations can be used again. 

r i 

Example 3.2.4. (DelvesandMohamed 1974,p. 33)Compute / by 

J -1 v 1 — t 2 

using both open and closed Gauss-Chebyshev rules, for n = 2. Note that f(x) = x 2 . 
Then 


(i) Open Gauss-Chebyshev rule: For n = 2, T 2 (x) = 2x 2 — 1, 
£i = —l/yj2 and £2 = l/\/2. The integral is exactly equal to 



and its zeros are 
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(ii) Closed Gauss- Chebyshev rule: For n 
0 , 1 , 2 , i.e., £ 0 = 1 , £i = 0 , and £ 2 = 

|[i(l) 2 + (0) 2 + i(-l) 2 )]=|. - 


n r 

2 the nodes are ^ = cos —, i = 
1. The integral has the exact value 


Example 3.2.5. (Ralston-Rabinowitzl978,p. 110)Compute// = 


/: 


e x dx 

-1 yjl — X [ 

correct to six decimal digits. Using (3.2.12) we find that the error for the n-point rule 
is bounded by 

IE.' ' 2m 


2 2n (2n)l ’ 


Thus, |E/ 4 1 < 1.66 x 10 6 , and |E 5 | < 4.6 x 10 9 . Hence, we apply the Gauss- 
Chebyshev rule for n = 5, which gives 


If 


IT 

5 


5 

E ex p 

2 = 1 


COS 


( 2 z — l)ir 
10 


= 3.977463. - 


If instead of the Chebyshev polynomial of the first kind T n (x) we take the inter¬ 
polating polynomial as the Chebyshev polynomial of the second kind U n (x), we use 

the relation U n (cos 0) = s ^ n ( n a nd obtain the quadrature rule 

sin 0 

r 1 EE / kir \ 

/ f{x)dx « E^-Rcos ——-J, (3.2.18) 

•^ _1 k =i n + 


which is precise for / G V n ~i, where 

[(n—1)/2] 


W k = 


where p = 2 


n + 1 
n + 1 


1-2 E 


cos ( 2 mOk) 1 


^ 4m 2 — 1 p 


-cos(p+ l) 0 fc 


= 


kir 


n + 1 ’ 
(3.2.19) 

— 1 is the largest odd integer < n. An alternative form of w k is 


, • >3 [(n—1)/2] 

4 sin 6/*, ^ sm(2m — 1)6^ 

n + 1 ^ 2m — 1 

772=1 


(3.2.20) 


As in the previous case, these weights can be proved to be positive. In either case, 
as n —» oo, the Gauss-Chebyshev rules converge to f(x) dx for all /, which are 
Riemann-integrable in [—1,1]. 

The equal-weight Chebyshev rule is 



dx = - E f (xi) + R n 

T) f -J 
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where the node Xi is the i-th zero of the polynomial part of 
„ r / n n n 

x exp i It3U + T5U + U7R + “‘J)’ 

which are given in Table A. 11 for n = 2(1)9; for n = 8 and n > 10 some of the 
values of Xi are complex; the remainder R n is given by 

/T rpn+l o n 

R n = / r —TJ / (n+1) (0 dx - - £ U +1 (U , 

J-i {n + 1)! n(n + l)!f^ 

for 0 < < x and 0 < & < x*, i = 1,... , n. 

There are two Gauss-Chebyshev Rules on an arbitrary interval [a, b]: 

1. Using the Chebyshev polynomials of the first kind, T n (x), where T n ( 1) = 
1 /2 n—1 , we have 


L 


b 


f(y ) 

V(y- a )( b ~y) 


n 

dy = '^2w i f(y i ) + R n , 
i=1 


where the nodes yi 
the same as above. 


+ 


b — a 


Xd , with Xi = cos 


(2 i — 1 ) 7 r 


2n 


; the weights are 


2. Using the Chebyshev polynomials of the second kind 


U n (x) 


sin[(n + 1) arccosx] 
sin (arccos x) 


we get 


/» b i 2 n 

/ f(y) V(y~ a)(y Z xjdy= (— ^2 w if(yi) 

J a i=1 


R ri 


where the nodes are and the weights are the same as in 1 above. 

3.2.8. Gauss-Log Rule. The Gaussian rule with a logarithmic singularity is 



n 

dx = Wi f (xi) + R n , 

i=l 


where R n = 


/ (2w) (g) 

(2 n)! 


n = 2,4,8,16. 


r n , and the nodes and the weights are given in Table A. 12 for 
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3.3. Other Extended Rules 

Some useful extended rules are as follows. 

3.3.1. Clenshaw-Curtis Rules. It is well known that for smooth integrands 
f(x) the Gaussian rules give better accuracy than the Newton-Cotes rules including 
the trapezoidal and Simpson’s rules. Even if f{pc) is not smooth, the Gaussian rules 
provide results no worse than the other types of rules. From a practical point of view, 
the weight function w(x) = 1 is more common than the Chebyshev weight function 
w(x) = 1/y/l — x 2 . Often we write 

Ei(/) = J ^ /( x) dx = j ^ , (3.3.1) 

where g(x) = y/l — x 2 f(x). But if f(x) is smooth near x = =bl, g(x) is not, and 
the Gauss-Chebyshev rule will provide the result which converges very slowly as N 
increases. However, the Clenshaw-Curtis rule (Clenshaw 1957, Clenshaw and Curtis 
1960) removes this situation and provides an effective quadrature rule (see Clenshaw 
and Curtis 1960). Quadrature formulas based on Chebyshev nodes transformed to 
the interval of integration [a, b] and known as the Clenshaw-Curtis formulas are more 
suitable for numerical integration than the Newton-Cotes formulas. The Clenshaw- 
Curtis formulas with the weight function w(x) = 1 are called modified Clenshaw- 
Curtis formulas. Consider the integral iLx(f) and assume that the integrand f(x) is 
continuous and of bounded variation on [—1,1]. Then f(pc) is approximated in terms 
of the Chebyshev polynomials of the first kind by 

n 

f(x) = Y J "wkT k (x). (3.3.2) 

k =0 

To determine the coefficients w k we use the orthogonality condition 

0 if j , 

n ifi=j=0orn, (3.3.3) 

n/2 if i = j ^ 0 or n. 


£" 

m =0 


mm irjm 


cos - 


= < 


n 


n 


7rm TTTFlk 

Let t m = cos-. Then after multiplying both sides of (3.3.2) by cos-, we get 

n n 


Yh" fitm) 


n n 


m =0 


TTTflk v—> n v— y'f . % 

COS = y ^ y ^ Wk Tfc (tm) 

m =0 k =0 


nmk 


cos ■ 


n 


n n 


E n ^—> u 7T km 7ikm n 

y w k cos- cos-= 7 : w k, 

n n 2 

m =0 k =0 
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which implies that Wk can be computed from the formula 

7r km 


cos ■ 


u = f( 


n J 


Next, we use the result 
the Clenshaw-Curtis rule 


n ' 

m =0 

fwdx=< Vil - k2) - ken 


= /( cos—). (3.3.4) 


1 0 , 


k odd, 


(see §1.3) to yield 


U(/) = 4(/) + -^n = 


k=0 


= - E"uE 

n. z ^ z ^ , 

fc=o I 0, 


i-fc 2 ( 


&7T> 

n 

7rmk\ 


cos ■ 


n 


m=0 


k even 
k odd 




(3.3.5) 


This rule is exact if / E T^n-u 

To generate this rule, Clenshaw and Curtis (1960) start with the expansion of f(x) 
in terms of the Chebyshev polynomials of the first kind T n (x): 


oo 

f( x ) = E' UjW- 


j =0 


(3.3.6) 


Then 



E' 6 J / T j( x ) dx 

3=1 J ~ X 


E' 


n=0 


2 bn 

1 — n 2 ’ 


n even 



cos j# sin 0 d6 


(3.3.7) 


where the coefficients bj are given by 


= 2 f 1 fjx)Tjix) 

^ k J -1 Vl — a; 


(3.3.8) 


These coefficients can be computed by using the closed Gauss-Chebyshev rule; thus, 
from (3.3.8) we get 


bj 


a » = ^ E”/( 


kir^ 


cos ■ 


cos ■ 


J7T 


j = 0,1,... ,n, 


fc =0 


Then the Clenshaw-Curtis rule is carried out in two steps: 


(3.3.9) 


2005 by Chapman & Hall/CRC Press 








3.3. OTHER EXTENDED RULES 


127 


(n) 

(i) Compute a - for j = 0,1,... , n from (3.3.9). We need only the coefficients 
with even indices; 

n „ 2 a (n) 

(ii) Compute If = £ rz~2- (3.3.io) 

j=0 3 

n even 

Note that the last term in (3.3.10) is halved so as to obtain the result identical to the 
original derivation. The term a^ is usually very small. By combining the above 
two steps, we obtain 


where 


T f ST-" 4 3 kn t( k7T 

lt=y 7--— COS- J COS- 

^ (i - J 2 ) n n V n 


= £'W 


kir 


cos ■ 


(3.3.11) 


k =0 


4 1 jkTT 

w k = - y z — zo c ° s —• 

7 r 1 — j n 

3 =0 J 

j even 


(3.3.12) 


If the rule (3.3.11) is applied directly, the cost of its implementation is very high. A 
direct computation of (3.3.12) to compute Wk, k = 0,1,... , n, comes to (n + l) 2 
multiplications and additions, as compared to only (n + 1) to compute (3.3.11) or 
(3.3.10). But since (3.3.9) has the form of a direct cosine transform, the coefficients 
Wk can be computed using FFT in 0(N In N) operations. The resulting rule is very 
stable and effective in cost. The above generation of the Clenshaw-Curtis rules, due 
to Imhof (1963), is based on the generalized Fourier expansion of the integrand f(x) 
in terms of the Chebyshev polynomials T n (x). 

O’Hara and Smith (1968) have studied the errors in the Clenshaw-Curtis rules. 
To obtain the error estimate, they integrate the generalized Fourier expansion of f(x) 


/(*) = £' A kTk{x). (3.3.13) 

k=0 

Let E n denote the exact value of (/) minus the value found by using the n-term 
approximation I n (f) in (3.3.11). Then comparing (3.3.13) and (3.3.4) we find that 

2 ^—> // nkm ^—> / irim 

Wk = — > cos- > Ai cos- 

n n n 

m =0 i=0 

= Ak + A2 n -k + ^-2rt+fe + Ajrt-fc + Ai n+ k + ‘ ‘ • 

(3.3.14) 
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Thus, from (3.3.5) we have two expressions, one for I n (f) and the other for (/): 


In(f)=W C 


2 w 2 2 w 4 

rr3 _ 3^5 


(n — 3)(n — 1) (n — 1 )(n + 1) ’ 


I 1 -i(f)=A 0 


2 A 2 2 A 4 

rr3 _ 3^5 


which after subtraction give 


E n — 2 A 2n — -—- y^2n-2 + ^2n+2j ~ ’ 
- (n _ 3) 2 (n _l) (A n+2 + A 3n _ 2 


2-Tn+2/c 

(n + 2fc — l)(n + 2fc + 1) 


(3.3.15 


Since f(x) is assumed to be smooth, the coefficients decrease more rapidly for 
large n, and therefore, we can ignore terms higher than As n . Also, we take n to be 
even. Then from (3.3.15) we find 

n / 2—1 9 a n/ 2 —l 

p _ ^^ 2 n- 2 k ^2n+2/c 

n ~ 2 ^ 4fc2_i + Z, 4fc2_i 

fc =0 fc =0 

n_1 9 a 

_ ^n+2fc _ 

(n + 2 k — l)(n + 2 k + 1) ’ 

fc=i 

which, after combining terms, where those in the first and third summations cancel, 
reduces to 


16 • 1 • n 16 • 2 • n 

n = (n 2 - l 2 ) (n 2 - 3 2 ) A ” +2 + (n 2 - 3 2 ) (n 2 - 5 2 ) ^ n+4 
16(n/2 — l)n / 0 2 

+ 3(2n — l)(2n — 3) A2 ”- 2 “ V + 4^1 ^ 

+ (3“(2n + l)(2n + 3)) j42 ” +2 + '" ’ 


(3.3.16) 


This expression clearly shows why the Clenshaw-Curtis rule is more accurate than 
its degree implies. The first two terms in (3.3.16) are dominant, but the factors 
multiplying A n+2 and A n+ 4 are of the order 1 /n 2 , which make them very small, and 
therefore, provide better result with only a small sum. Thus, the Clenshaw-Curtis rule 
is very effective and numerically stable to high degree, like the other Gaussian rules. 
This rule is also self-contained since it does not require any tables for the weights 
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Wk, which makes it independent of the order of the formula to be used. This property 
enables the Clenshaw-Curtis rule to be operative on very small and portable computer 
systems. Gentleman (1972) uses fast cosine transform to implement this rule. 

Another variation of the method for generating the Clenshaw-Curtis rule is due 
to Evans (1993b) and uses the trapezoidal rule in such a way that the error term in 
the Euler-Maclaurin summation formula (2.2.8) can be made zero. This method is 
realized by setting x = cos 6 in (3.3.8), which gives 

bj = — f /(cos 6) cos jOdO. (3.3.17) 

n Jo 

Then by applying the trapezoidal rule to (3.3.17) we obtain the approximation 


b j 


2 

n 


E tt ( irm 

g[ cos- 

^ n 


771=0 


irjm~ 

cos- , 

n J 


(3.3.18) 


which is identical to (3.3.4). But the quadrature rules are not identical because in rule 
(3.3.5) the summation is , whereas in rule (3.3.7) it is . However, for smooth 
integrands the rules will converge rapidly and the above difference in the last term 
will almost vanish in terms of computational accuracy. 

A completely complementary set of quadrature rules of the Clenshaw-Curtis type 
is based on the use of an expansion of the integrand f(x) as 


f{x) = Y,CkT' k {x)+E n , (3.3.19) 

k=0 

where, after setting x = cos0, we have T k (x) 
orthogonality relation 

0 

n/2 if i = j ^ 0 or n, 
n if i = j = 0 or n, 


£" 

m =0 


. mm . rnjTi 
sm- sm-= < 


k sin kO 


suit 


= kUk(x). We use the 


if * + 3, 


to determine the coefficients c k in (3.3.19) in the same manner as in (3.3.4), and we 
find that 



m =0 


irm 


cos ■ 


. 7T771 . 7 Tjm 

sm- sm-, 

n n 


(3.3.20) 


which yields 


/!,(/)«/„(/) 




k =i 


2 k even, 
0 k odd. 


(3.3.21) 
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Alternatively, for the approximation (3.3.19) we have 

Ck = ^2 J f( x ) T k( x ) A ~X 2 dx 

= —r f /(cos#) sin# sin hOdQ. (3.3.22) 

Jo 

Another variation of (3.3.22) is obtained by applying the Gauss-Chebyshev quadrature 
rule to obtain the requisite weight (l — x 2 ) . Then the formula 

2 f 1 f(x)T^(x) (1 - a; 2 ) J 

Ck 7T k 2 J_ x Vl - X 2 


gives 



n 

^ / (cos 9 m ) sin kO , 

m =1 


sin 0 m 


where 9 m 


(2m — 1)7r 
2n 


. This yields 


n f 2 

7n(/) = n 

fc=l ^ u 


if k even, 
if k odd. 


which is the same as (3.3.21). Further, the relation (3.3.20) can be obtained by using 
(3.3.22) directly with the trapezoidal rule. 


The Clenshaw-Curtis rules arise when we incorporate the endpoints —1 and 1 
as nodes in the Fejer’s (2 n — 2)-point rule (see (3.2.15)). Thus, the nodes in the 

( (% — 1)77 \ 

-I for i = 1,... , n, and the weights 

n — 1 J 

at these nodes are given by 


w 1 =w n = < 


1 


(n — l) 2 

1 


Wj = 


n(n — 2) 

[(n—1)/2] 


if n is even, 


if n is odd, 


1 - E 


2 {2j(i-l)it 

COS ' 


J=1 


4 p - 1 


n — 1 


z = l,... ,n — 1, 


where * means that the last term in the sum is halved if n is odd. 

Piessens and Branders (1983) have applied a modified Clenshaw-Curtis rule to 
compute the integrals of the form I^(kf), where k(x) is one of the singular functions 

(x — a) a , (x — a) a In (x — a), (b — x) a , and (b — x) a In (b — x), where a > —1. They 
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n 

do it by first approximating f(x) by a Chebyshev series f(x) ~ Ti(x). Then 

i=0 

n 

Ia(kf ) ~ c i Mi(x), where Mi are the modified moments of k(x) with respect to 

i =o 

the Chebyshev polynomials Ti(x) and can be computed by recurrence formulas (see 
§4.4.10). 

3.3.2. Gauss-Kronrod Rule. The Gauss formulas do not reuse the function 
values computed previously because these rules do not have any common nodes 
(quadrature points), except, possibly, the midpoint of the interval of integration, and 
thus, they do not allow the reuse of previous /-values. Kronrod (1965) devised 

n 

a method by which an n-point Gaussian formula K n (f ) = w k f ( x k) with n 

k= 1 

preassigned nodes is used to construct a (2 n +1)-point formula in such a way that the 
resulting formula possesses a high degree of accuracy, which is 3n +1 for n even, and 
3n + 2 for n odd. Since the n nodes are preassigned, the remaining n + 1 nodes are 
located in the intervals (a, x ), (or, x ^),... , (x n , b ), where aq, X 2 , • • • ,x n denote 
the preassigned nodes of K n . 

The linear Gaussian rule 

pb n 

/ /( x) dx sa G n (f) = X w i f ( g + (b ~ a ) x i) , (3.3.23) 

Ja i= 1 


where w^Wi ^ 0, are the weights and Xi the nodes of the quadrature, is unique, and 

its accuracy is 2n — 1; i.e., this rule is accurate if / E V^n- 1 - Note that the integral 

h a r 1 x cl 

f a f(x) dx reduces to —-— J f (x(t)) dt by the substitution t = 2--1. 

Kronrod uses the Legendre polynomials L n (x) of degree n which are orthogonal on 
[—1,1] (see §1.3). Then any polynomial of degree not higher than 2n — 1 is also 
integrable by formula (3.3.23), since any such polynomial can be represented in the 
form 

71—1 

P n -i(x) + ^2C k x k L n (x), (3.3.24) 

k =0 

where P n _ i(x) is a polynomial of degree not higher than n — 1. Since each term 
in (3.3.24) is integrable accurately by the Gaussian rule G n (f ), the sum is also so 
integrable, and therefore it it has accuracy 2n — 1. 

To construct another quadrature with maximum possible accuracy, Kronrod con¬ 
siders the &-th moment of the polynomial L n (x ), which is defined by 


K-n,k — 



x k dx. 


We set P n+ 1 (x) = x n+1 -\-p n x n -\-p n -1 x n 1 H-hpo- Since L n {x) is orthogonal 
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on [—1,1] to all powers of x k for k < n, we have 
J L n (x) P n+ \(x) = J L n (x) [x n+1 +p n x n +p n -ix n ~ 1 H- \-po]dx 

= -A-f/i,'/i-)-/,•+! T Pn M n ,n-\-k T * * * H - Pn—k ■^-n^m k = 0, 1, . . . ,71. 

This yields a recurrence formula for p^: 

Pn -\-1 = 1? 

'AT n?n |i 


Pn — 


M 


Pn— 1 — 


Pn—k — 


■n,n 

Mn ,n+2 Pn+1 
M n ,n Pn 

.5 

M n ,n- 1-1 Pn+1 T * * * T M n ,n- 1-1 Pn—/c+1 
M n ,n Pn 


Using this relation, we compute the moments M n? /c by the formula 

"71 

M n ,n+2k = M n , n +2k-2 ^1 H 

Kronrod (1965) develops a modified Gaussian formula 

2n+l 

K n (f)~ + /+)> (3-3.25) 

i=l 

which has an accuracy of 3n-b 1 for even n and of 3n-b 1 for odd n. Table A. 13 contains 
the nodes Xi and weights Wi or Wi for the formula G n (f) or K n (f), respectively, 
for 7i = 1(1)5; extensive tables are available in Kronrod (1965) for ti = 1,... , 40 in 
decimal form (and ti = 1,... , 50 in octal form) for the interval [0,1]. 

Example 3.3.1. (Kronrod 1965) To compute fjf f(x) dx, note that a = 2.1, 
b = 7.3, so b — a = 5.2, and we use ti = 5. Then, using Table A. 13, we get 

G 5 (/) = 5.2 [0.1184634425280945 x /(2.1 + (5.2)(0.0469100770306680)) 

+ 0.2393143352496833 x / (2.1 + (5.2)(0.2307653449471585)) 

+ 0.2844444444444444 x / (2.1 + (5.2)(0.5)) 

+ 0.2393143352496833 x / (2.1 + (5.2)(0.7692346550528415)) 

+ 0.1184634425280945 x / (2.1 + (5.2)(0.99920426800474212)) ]; 


71 - 


+ 2fc- 1 


2ti T 2k T 1 
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K 5 (f) = 5.2 [0.0212910183755409 x /(2.1 + (5.2)(0.079573199525788)) 

+ 0.0576166583112367 x / (2.1 + (5.2)(0.0469100770306680)) 

+ 0.0934008982782463 x / (2.1 + (5.2)(0.1229166867145754)) 

+ 0.1205201696143238 x / (2.1 + (5.2)(0.2307653449471585)) 

+ 0.1364249009562795 x / (2.1 + (5.2)(0.601847934191084)) 

+ 0.1414937089287456 x / (2.1 + (5.2)(0.5)) 

+ 0.1364249009562795 x / (2.1 + (5.2)(0.6398152065808916)) 

+ 0.1205201696143238 x /(2.1 + (5.2)(0.7692346550528415)) 

+ 0.0934008982782463 x / (2.1 + (5.2)(0.8770833632854246)) 

+ 0.0576166583112367 x / (2.1 + (5.2)(0.9530899229693320)) 

+ 0.0212910183755409 x / (2.1 + (5.2)(0.9920426800474212)) ]. ■ 

A detailed discussion of Gauss-Kronrod rules is available in Piessens and Branders 
(1974). 

3.3.3. Patterson’s Rules. Unlike the Gauss-Kronrod rule, Patterson (1969) 
developed an alternative method of augmenting an n-point quadrature formula by 
p-points. The n + p nodes of the new formula are zeros of the polynomial G n + P (x) 
yet to be determined. Then a general polynomial of degree n + 2p — 1 is written as 

v -1 

F n -\-2p— 1(3?) = Qn+p— 1 (^) + Gn-\-p{%) E c k x k , (3.3.26) 

k= 0 

where Q n+p -i(x) E V n + P -i is a general polynomial. The polynomial F n+ 2 P -i(x) 
defined in (3.3.26) is subjected to the constraint 

J G n+P (x) x k dx = 0, k = 0, 1, ... ,p — 1, (3.3.27) 

and it is then integrated exactly by an (n + p) -point formula. This yields a rule with 
(n + p) nodes. The constraint (3.3.27) can be generalized to 

J G n+P {x) P k {x) dx = 0, k = 1,... ,p- 1, (3.3.28) 

where Pk(x) are the Legendre polynomials. Then the polynomial G n + P (x) is ex¬ 
pressed in terms of a series of Legendre polynomials 

n+p 

G n+p (x) = Y / tiP i (x), (3.3.29) 

i =0 
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and substituting it into (3.3.28) yields 

n+p i 

tj / Pi(x) Pp{x) dx = 0, k = 1,... — 1. (3.3.30) 

i =0 

In view of the orthogonality of the Legendre polynomials on [—1,1], Eq (3.3.30) 
implies that U = 0 for i = 0,1,.. .p — 1. Hence, Eq (3.3.29) reduces to 

n+p 

G n +p(x) = YjiPjjx), 

i=p 

which, in view of the symmetry of the nodes, is further simplified to 

[n/2]+l 

G n +p{x) = Y CiP 2 i- 2 +p+q(x), q = n~2[n/2}. (3.3.31) 

i=l 

Without loss of generality, we choose C[ n / 2 ]+i = 1. This leads to the following 
system of linear algebraic equations 

In/ 2] 

Y G p 2 i- 2 + P + q (xj) = -P n +p (xj) , j = 1,2,..., [n/2], (3.3.32) 

i=l 

which can be solved for the coefficients ci, c 2 , • • •, C[ n / 2 ]- This determines the poly¬ 
nomials G n+P (x ) completely as defined by (3.3.31), and thus the zeros of G n + P (x) 
make the set of extended nodes. 

Morrow (1977) has noted that few such Patterson-type extensions of the Gaussian 
rule exist. The most commonly used rule is based on the 3-point Gauss-Legendre 
formulas, which has been extended to 7, 15, and 51 points. For practical purposes 
this rule is highly competitive with the Clenshaw-Curtis rule. 

The nodes xp and weights wp for the Patterson quadrature rules 3, 7, 15, 31, 
63 and 127 points, where the 3-point rule is the normal Gauss-Legendre rule, are 
presented in Table A. 14. 

The NAG routine D01AHF provides an implementation of this rule, with the 
sequence of orders up to 255-point rule. If convergence is not attained at this limit, 
the subintervals are then halved, and the e-algorthm (EPAL, see Wynn 1956; algo¬ 
rithms .pdf on the CD-R) is used to accelerate convergence. 

Note that the Gauss-Kronrod Rule is a particular case of Patterson’s quadrature 
rule withp = 1. 

3.3.4. Basu Rule. This rule uses the relation U n -\{x) = — T^(x), where 
T n = cos nO, x = cos 0, is the Chebyshev polynomial of the first kind, and expands 
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a function f(x) of bounded variation in [—1,1] in a series of T^(x): 

oo 

f{x) = ^2 a n T' n (x), (3.3.33) 

n =1 

where 

a n = —L [ (l -x 2 ) 1/2 T' n (x) f{x)dx. (3.3.34) 

7m J_ 1 

In general, the weights in (3.3.34) cannot be evaluated, so the coefficients a n are 
approximated by using the Filippi’s quadrature scheme (Filippi 1964), which is as 
follows. Let f(x) be approximated by a polynomial pn-i(x) over the zeros of 
T'n+i ( x ) so that 

N 

Pn-i(x) = Y. B KNT’ n {x), (3.3.35) 

k =1 

where 


Bk,N = 


(N- 


> N 

lypS i 1 ~ X i) T k / (*i) » = cos * = 1 ( 1 ) 7V - 


Filippi’s quadrature formula for (3.3.35) is 



(3.3.36) 

M 

2 ^ #2z+l,iV 
i=0 

(3.3.37) 


where 


( N- 1 


M = < 


if TV is odd, 


TV-2 . 


if AT is even. 


Then substituting the values of £? 2 i+i, 7 v from (3.3.36) into (3.3.37) we obtain 



N 

yr a u u), 




where 


A* 


4 

tvTT 




The error in formula (3.3.38) for large N is 


\En-i 


< 


&N,N+3 
p 2 - 1 


(p + p- 1 ) 2 

pAT+l _ p-(N+ 1) 


M(p), 


(3.3.38) 


2005 by Chapman & Hall/CRC Press 



136 


3. GAUSSIAN QUADRATURE 


where 

N+l 1 

<Tw ’ Ar+3 = 2 ^ 2 UTI’ 

m =1 

M(p) is a constant depending on p which is the radius of the circle where f(z) is ana¬ 
lytic. Thus, in this rule the nodes are at x\ = l,x n = — l,and(G = cos 

for i = 2,... , n — 1. The weights in this rule are not all positive, but the se¬ 
quence of sums of | Wi \ is uniformly bounded, and thus the Basu rule converges for 
all/eC[—1,1]. 

Example 3.3.2. (Basu 1970) Consider dx/(x+ 4) = ln(5/3) « 0.510825. 
For p = 7 and M(p) = 2.33333347, the results for the error are as follows: For N = 
3 : E = 1.66(— 03); for N = 5 : E = 4.02(-05); for N = 7 : E = 9.3(-07); 
and for N = 9 : E = 2.0(-08). ■ 


/ (2i-3)7r \ 
V 2n — 2 ) 


3.4. Analytic Functions 


Let w > 0 be the weight function on the interval [—1,1], To approximate I-i U/)> 
we use interpolatory quadrature formulas of the form 

n 

Qn(f) = ^2w k , n f (x k , n ) , (3.4.1) 

fc=1 


where —1 < x\^ n < X 2 , n < • • • < x n?n < 1. If the integrand / is analytic in a 
simply connected and bounded region D of the complex plane containing [—1,1] in 
its interior, the remainder term R n (f) = I( w f ) — Qn(f ) is given by 

#«(/) = 2- f K n (z, w) f(z) dz, 

2^7r J r =dD 

where K n (z,w ) is the kernel of the functional R n (f) (or of the quadrature rule 
Qn(f)), and is given by 

jy r ( X Qn{z) 

K n (z, W) = - 

Pn(z) 

Pn(z) =C(Z- X 1}n ) • • • (z ~ X n , n ) , 

Qn(z) = [ w(x) dx for z G C\[—1,1]. 

J -1 z-x 


Alternatively, 



^ k,n 


Z 


%k,n 
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The quadrature formula (3.4.1) has the error estimate 

\R n (f)\ < ^ max\K n (z,w)\ max|/(^)|, 
z7T zer zer 

where 1(F) denotes the length of T. The contours T are generally taken as concentric 
circles centered at the origin or confocal ellipses S with focii at ±1 and defined by 
S p = \ \pe l ° + p~ l e _z0 ], 0 < 6 < 2i r, p > 1. A good estimate of the bound 
for the error R n (f) is possible only if one can estimate max \ K n (z, w) |. For this 

zeY 

purpose the location of the extremum of | K n | must be determined. It becomes easier 
to calculate \K n (z,w)\ in the case when Q n (f) is a Gaussian rule. Gautschi and 
Varga (1983) have provided effective algorithms to calculate \K n (z, w ) | at any point 
z outside [—1,1]. The evaluation of the maximum point for | K n (z, w) | in the cases of 
circular or elliptic contours has been investigated by Gautschi and Li (1990), Gautschi 
(1991) and Peherstofer (1993), where the results obtained in these studies deal with 
Chebyshev weights or for cases where w(x)/w(—x) is monotone. 

3.4.1. Symmetric Weight Functions. Let w be a symmetric weight on 
[—1,1], i.e., w(—x) = w(x) for every x E [—,1]. A generalized Gauss-Lobatto 
quadrature formula is (Hunter and Nikolov 1999) 


N -1 


Q { n N) U) = E [/°' } (-l) + (-l) j / 0) (l)] + 5>2 - (3-4.2) 


3 =0 


k =1 


where the remainder term R^ = I(wf ) — Q^\f) is identically zero if / E 
7^2(n+A)—l • I n particular, Qn\f) is the n-point Gaussian quadrature formula 

n 

Q ( nHf) = Qn(f) = J2 W k,nfKn) ’ A 4 - 3 ) 

k=1 

Qn\f ) is the (n + 2)-point Gauss-Lobatto quadrature formula 

n 

Qn ) (f) = Qn(f)= A n LfU 1 ) + /(!)] + E f FD ’ A 4 ' 4 ) 

k =1 


and Qn^ (/) is the (n + 2)-point Gauss-Lobatto quadrature formula with double end 
nodes, i.e., Q (/) = Qn ,d (f )• The kernel K ^ (z, w) of formula (3.4.3) is evaluated 
on elliptic contours £ p by Schira (1997). The intersection point of the ellipse £ p with 

the positive branches of the real and imaginary axis is given by z r = ^ ^ — and Zi = 

i (p — p _1 ) 

—— --, respectively. It is found that for the weight function w(x), symmetric 

on [—1,1], such that (i) w(x)y/l — x 2 | on [—, 1], or (ii) w(x)/\/l — x 2 | on 
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[—1,1] (i.e., w{x) is the Gegenbauer weight function w a (x ) = (l — x 2 ) a , a > — 1, 
a </ ( — 1/2,1/2)), the extremum of K^ coincides with z r in the case (i) and with 
Zi in the case (ii), provided p is not less than some prescribed value which is given 
explicitly in the following cases. 

If w(x)y/l — x 2 | on (0,1), then 


ma^\K^ +2 (z,w)\ = \K^ +2 (z r ,w)\ for all p> 1 . (3.4.5) 

For n = 0 this result is true for all p > 1. 

The kernel K^ (z, w ) of formula (3.4.2) for a symmetric weight function w(x) 
on (—1,1) is represented by 


K < n n \z,w) = (- 1) n Y^ 


r w 

n+2/c+2 

T) 


k =0 u n-\-2k 






r W 

l 2+2/c+2 


(*) 


(3.4.6) 


for z G C\[— 1,1], where i is the j-th orthonormal polynomial with respect to 

the weight function (x) = (l — x 2 ) N w(x) and is its leading coefficient. 
For N = 0 and 1, the representation (3.4.6) is given in Schira (1997). Other useful 
results are: 


max\K% +2 (z,w)\ 

zes p 


\ K n+ 2 ( z ii w )\ for all p > 


3.88 if n is odd, 
3.72 if n is even; ’ 


and 




max | K^ 2 (z, w) \ = \K^ 2 (z r , w) | for all p > 1 

For the Gegenbauer weight function w a (x) = (l — x 2 ) a , a > —1, 
a </ (—1/2,1/2)), we have 


m&x\K% +2 (z,w a )\ = \ 

zes p [ 


\ K n+ 2 ( z r,w a )\ if — 1 < a < -1/2, n > 1, 

\K% +2 (zi,w a )\ if a > 1/2, n > 3; 

1 +V3 


max|if„ 4 2 ( 2 ;,w) a )| = \K n ’ +2 (z r ,w a )\ for all p > ; 

mjxx\K% +2 ( z ,w_ 1/2 )\ = \K% +2 (z r ,w_ 1/2 )\ for all p > 1; 
max \K^ +2 (z, u>i/ 2 ) \ = \K^ +2 {z u w 1/2 )\ for all p > p(n); 

Z ttn 


max | K n ± 2 (z,W- 1/2 )\ = \K n ± 2 (z r , w_ 1/2 )\ for all p> 1, 

z sz & p 


where lim^oo p(n) = 1. Some values of p(ri) are: p( 3) = 3.8318, p{ 4) = 3.2308, 
p(5) = 3.0022, p( 6) = 2.8791, p{ 7) = 2.8000, p(8) = 2.7447, p{9) = 2.7036, 
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p(10) = 2.6718, /9(H) = 2.6464, p(12) = 2.6256, /o(13) = 2.6083, p(14) = 
2.5937, ,9(15) = 2.5811, ,9(16) = 2.5702, p(17) = 2.5607, p(18) = 2.5522, 
p(19) = 2.5447, p(20) = 2.5380, p(21) = 2.5319, p(22) = 2.5264, p(23) = 
2.5214, p(24) = 2.5168, p(25) = 2.5126, p(26) = 2.5087, p(27) = 2.5052, 
p(28) = 2.5019, p(29) = 2.4988, p(30) = 2.4959, p(60) = 2.4548, p(100) = 
2.4385. 

3.4.2. Optimal Quadrature Rules. To generate quadrature rules of the 
highest degree of precision with arbitrarily preassigned nodes for general constant 
weight functions, Patterson (1989) considers the quadrature rule 


n m 

Ia(wf) ~ fc(n, m) = ^ / (x k ) + ^2 Ak + n f ( x k+n ), (3.4.7) 

k =1 k =1 

where the n nodes x\, ... , x n are preassigned, and the m nodes x n+ i,... , x n+m , 
which are called the optimally added nodes, are free and are to be computed so as 
to achieve the highest degree of precision. As mentioned above, Kronrod (1965) 
computed tables of such rules; in fact, he took the n preassigned nodes as the zeros 
of P n (x) and used the Gauss-Legendre rule; he also computed additional (n + 1) 
additional nodes to provide all 2n +1 nodes. These additional nodes are the zeros of a 
polynomial 0 n+ i(x) such that x n P n (x ) 0 n+ i(x) dx = 0 for k = 0,... , n. Let 
4>i(x), i = 1, 2,... , denote a set of polynomials orthogonal on the interval [a, b] with 
respect to a constant weight function w{x ), where J ^ w{x) 4>i{x) (j)j(x) dx = hj 6ij 
defines the j-th moment integral, where 6ij is the Kronecker delta, such that 

0n+1 — (Ck X + dk) + &k §k- 1? (3.4.8) 

with (f)_i = 0, 0o = 1, where Ck-ihk-i = — hk- This yields 



To construct an (n + m) mode quadrature rule which has n preassigned nodes, let 
these preassigned nodes be the zeros of a polynomial q n (x), where 


n 

<ln{x) = 'P Y 4>i{x), 

i=mo 1 


m 

and let p m (x) = £ m be the polynomial to be determined with the m ad- 

i=0 

ditional nodes. Patterson (1989) proves that 7 Z(n,m), defined by (3.4.7), has the 
integrating degree n + 2 m + /i — 1, where p > 0, and that the quadrature weights 
associated with the s optimal nodes of the rule lZ{n + m, s) corresponding to the 
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extension of 7 Z(n, m) is zero unless s > m + p, p > 0. If p = 0, the orthogonality 
is nondegenerate. 

The polynomials p m (x) are computed as follows. If 

m n n-\-m 

q n +m{x) = q n (x)p m {x) = }j: fob = ‘G (3.4.9) 

j=0 i=mo * j=0 ^ 


then pj = 0, j = 0,... ,ra — 1, implies that g n (T)p m (x) 
coefficients ^ of Pm(x) are computed from (3.4.9). 


n+ra n . 
j=m 


' 3 * 


The 


Since it is computationally expensive to generate new Gaussian formulas, there 
are only a few commonly used combinations of intervals and weight functions avail¬ 
able for well-known Gaussian rules. These combinations are available in Table 1.3.1. 
However, the above Patterson’s method and the related algorithm can be used to 
produce specific individual quadrature rules or sequences of rules by iterative appli¬ 
cation of this method with all its details and algorithm presented in Patterson (1989). 
A method to reduce the number of coefficients necessary to represent Patterson’s 
quadrature formulas, to reduce the amount of storage of computed function values, 
and to produce slightly smaller errors is presented by Krough and Van Snyder (1991). 


3.5. Bessel’s Rule 

To compute 1(f) = J ^ f(x) dx numerically, we have Bessel’s rule (see Stummel 
and Hainer 1982, p. 75): 

B(f) = [~f( a ~ h) + 13 f(a) + 13 /(&) — /(& + h)\ . (3.5.1) 

This integration uses nodes outside the integration interval. Garloff et al. (1986) 
derive three new rules. Let [a, b] be a finite interval, and / e C 3 [c, d\, c < a < b < d. 
To compute I (/) choose the nodes Xi = a + ih, i = 0,1,... , n, and h = (b — a) / n. 
Assume that c < a — h/6 and b + h/6 < d, and let fo = f (#o)> fo = f (# 0 ) ? — 
Then let 

h = j f(x) dx = hfo fo "b^j - fo + jy f fff (Q, x 0 < £ < x\. (3.5.2) 
Replace f(x) by a linear function <j)(x) = fo + a (x — xo). Then 

r xi h 2 

h= (j>(x)dx = hfo + — a. 

.1 r.c ^ 
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We set a = — [f (xq + pih) — f (xq + P 2 h)\, where we determine pi,P 2 so that 

(3.5.2) and the Taylor’s expansion of I\ coincide in the highest possible degree. 
Expanding a, we have 


a = fo (Pi -P2) + ^ (pi ~ P%) + Y [/"' (Ci) Pi - f" (£ 2 ) pi] , 
where xo < Cj < x o + Pjh, j = 1, 2, then, substituting this into /i, we get 

A = + + “^“/o (Pi ~ Pz) + fo {Pi -Pi) + [/ ,,/ (6)Pi~/ /// (£2)^2] 5 

which yields I\ — I\ = O (h A ) ifpi — P 2 = 1 andpf — = 2/3, i.e., ifpi = 5/6 

andp 2 = —1/6. Then 


h = h 


f ( x o) + \{f ( x o + 5 U 6 ) - f ( x 0 - ft/6) )] ■ 


Similarly, for other subintervals [xi, Xi+ 1 ], z = 1, 2,... , n — 1, we have 

l+i = ft / (^i) + 1 {/ ( x i + 5ft/6) - f(xi- ft/6) ) . 

Using the relation / (xi + 5/z/6) = / (a/i+i — h/6), we obtain the quadrature for¬ 
mula 


n 

2=1 

n— 1 1 

= ft [ X! 1U) + 2(1 “ ft/ 6 ) - / (^o - ft/6) ) 

2 = 0 


(3.5.3) 


A related quadrature formula is 


J(f) = h^2f(xi) + -{f( x o + ft/6) -f(x n + ft/6) )j. (3.5.4) 

2 = 0 


Finally, set 


Q(f) = h hf) + J(f) 


= h 


r n— 1 


1 


E / ( x i) + o {/ ( X o) + / (Zn) } 

L i =0 ^ 


+ J {/ (xo + ft/6) -f(x 0 - ft/6) + / (x„ - ft/6)-/ (z n + ft/6) } .(3.5.5) 
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Thus, Q(f) is equal to a compound trapezoidal rule 

n —1 1 

T n (f) = h [£ / U) + 2 {/ fao) + f(Xn)}\ , 

2=1 

with the “end correction.” Since T n (f) is a Riemann sum, we get Q(f) —» 1(f) as 
n —> oo for all functions / G i?[a, ft] provided that the end correction tends to zero 
as n —> oo. Now, we compare the formulas (3.5.3)-(3.5.5) to some other quadrature 
formulas. Thus, 

(i) If Z(f) denotes a quadrature formula, define Rfk(f) = 1(f) — Z(f), where 
m represents the number of function evaluations needed to compute Z(f). The 
following error estimates hold: 

\r{ + 2 U)\ < (0.01105583 - 0.0017039/n) h z {b-a) sup | f"'{x)\, 

x£[a—h/6,b\ 

\ R l+ 2 U)\ < (0.01105583 - 0.0017039/n) h z {b - a) sup \f"{x)\, 

x£[a,b-\-h/6\ 

\R% +5 \<c k h k (b-a) sup \f (k \x)\, 

x£[a — h/6,b+h/6\ 

1 a/3 

for / G C k [a — ft/6, ft + ft/6], k = 1, 2, 3,4, where c 1 = -, c 2 = —, c 3 
1 1 ^ _ 23 

192 + 1296 n a ” ° 4 ~ 12960' 

(ii) For the compound Simpson’s rule (n even): 

S(f) = ^ [/ (xo) + 4/ (zi) + 2/ (x 2 ) + 4/ (x 3 ) + ... 

+ 2/(T n _2)+4/(x n _i) + / (x n )] , 

the error estimates are 

\R* +1 (f)\<d k h k (b-a) sup |/ (fe A)l, 

xG [ a,b] 

for / G C fc [a,ft], k = 1,2,3,4, and di = 5/18, d 2 = 4/81, d 3 = 1/72, and 
c ?4 = 1/180. If we compare (i) and (ii), we find that < d^ for k = 1, 2, 3,4. 

(iii) For the compound two-point and three-point Gaussian rules (n even): 

n/2 

G 2 (f) = h ^ [f (x 2i -i ~h 2 ) + f (x 2i -i + h 2 )}, 

, n/2 

G 3 (/) = — N! [5/ (^21-1 — ^ 3 ) + 8/ (a;2i-l) + 5/ (#2i-l + ^ 3 )] ) 
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with /12 = h/y/ 3 ~ 0.5773503/land /13 = h/y/b ~ 0.7745967 h, the error estimates 
are 

\Rn 2 1 < E; h 4 {b - a) sup \f {4 \x)\, for/e C 4 [a,b\, 

Z <' J xd[a,b] 

\ R 3 n/ 2 \ < ^7; h 6 (b-a) sup \f {6) (x)\, for/e C 6 [a,b\. 

oloUU xE[a,b] 

(iv) For the compound Bessel’s rule 

B(f) = h [\f (®o) + / (Zl) + ••• + / {x n - 1 ) + \ f ( x n ) 

+ { — / (#o — h) + f (a:i) + / — / (a; n + h) }], 

the error estimate is 

\ B n+3(f)\ < ^ h4 ( b ~ a ) SU P l/ (4) UI for/€ C 4 [a-h, b + h], 

x£[a—h,b+h\ 


3.5.1. Extrapolation. The Euler-Maclaurin formula (2.2.8) gives an expan¬ 
sion of the error of the compound trapezoidal rule T in terms of the step size h as 
follows: for / e C 2n [a , 6], 


1(f) = T(f) + nh 2 + r 2 /i 4 + • • • + r n -\h 2n ~ 2 + £i(/), 

„ _ 


(2/)! L' 


/ (2 i- 1 ) ( a )_/ (2 i- 1) ( 6 ) 


j = 1,2 ,... ,n- 1, 


(3.5.6) 


where Bj are the Bernoulli numbers, and E\ (/) = O ( Ir "). Using Taylor’s expan- 
sion, we have 


T(f) - 1(f) = (f(a) - f(b)\ + (f"(a) - f"(b)} 

h2n [/ (2n “ 1} (m) - / (2 ” _1) (m) 


2(2n — 1)! 6 2n 


-1 


where 771 E (a — /1/6, a) and 772 G (b — h/6,b). Substituting this in (3.5.6), we get 


1(f) — 1(f) + S 2 h 2 + 53 / 1 3 + • • • + S2 n -l/l 

r B k 1 


52/c = 


S2/c+l = 


(2fc)! 2(2fc — 1)! 6 2/c_1 

/( 2fc )(a) -f (2k) (b) 


2n—1 + E 2 (f), 

fW-'Xa) - fW-'Xb) 


k = 1, 2 ,... ,n — l, 


2(2k)\ 6 2k 

where E 2 (f) = O (h 2n ). Similarly, for J(/) we have 


^(/) — J (/) + t 2 h 2 + / 3 / 1 3 + • • • + t 2n -ih 2n 1 + Es(f ), 
t2k = S 2 k, / 2 /c+l = — 52/c+l, k — 1, 2, . . . , 74 — 1, 
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where Es(f) = O ( h 2n ). Combining these two, we find that 

1(f) = Q(f) + s 4h 4 + 56/l 6 + • • • + S2n-2h 2n 2 + E±(f), 

where E±(f) = O (h 2n ). Now, we consider quadrature rules for /, J, and Q for 
successively halving the step size h with hj = 2 -J 7i, rij = 2 J n, and applying 
extrapolation, we get 

n j — l 

!(/) = h 3 [ E f ( x °) + Hf( b ~ V 6 ) - f ( a - h j/ 6 )} * 

i =0 

j(f) = h j [E^ ( x o) + | {/ (® + hj/Q) - f (b + hj/6)} , 

i =0 

Qj(f) = \ [W) + Mf) , 

Define for k = 0,1,... , j — 1, 

= U/), iff/) = (2 fc + 3 -1) _1 [2 fc+3 /Ti(/) - ijtfi, 

= Jjtf), iff/) = (2 fc+3 - 1) _1 [2 fc+3 jTi(/) - Jj(f) , 

Qj = Qj(f), Cf f/) = (2 fe+3 - 1) _1 [(2 2fe+4 Qj + i(/) - <#(/)] • 

Then for each / E C 2n [c, d], we have 

2n—4 

/(/) = if/) + X! A+ 3 ^f +3 + O (if) , k < 2n - 4, 

m=k 
n —3 

/(/) = Qj(f) + E <&>+ 4 >f* +4 + o (/if), I < n - 3, 

m=k 

with suitably chosen constants +3 and r4m+4- Similar expression are obtained for 
Garloff et al. (1986) have considered the following examples numerically. 

r 

1. / cos (sin x — x) dx ~ 1.38246, 

Jo 

f 1 

2. / 4 (x 2 + l) 1 dx = 7r, 

Jo 

/V 2 _ 1/2 

3. / (1 - 0.81 sin 2 4 )) 7 d<f> « 2.28055, 

Jo 
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f 2 2 

4. / e~ x<2 dx ~ 0.88208, 

Jo 

f ^/ 2 

5. / \/cosxdx « 1.19814. 

Jo 

The Bessel’s rule I and Q will not be applicable in 5 if the integration limits contain 
the interval (7r/2, 37 t/ 2), because the factor y'cosx is not real in this interval. 


3.5.2. Nodes inside the Integration Interval. The formulas /, J and 
Q use nodes outside the integration interval. Now, we derive fourth-order formulas 
(see Ralston 1959) which use nodes inside the integration interval. 

If we replace the integrand f(x) by a linear function <j){x) = f(qh) + a (x — qh ), 
0 < q < 1, and use Taylor’s expansion about qh , we get 

1(f) ~ h \f(qh) + (\ -q) {/ ((q + Pi) h) - f ((q + p 2 ) h)] , (3.5.7) 


where pi, P 2 depend on q. As in the previous section, the only choice of p\ and 
P 2 such that 0 < pk + q < 1, k = 1,2, and (3.5.7) to be of order 4 is p^ = 
\ [l + (—l) /c 3 -1 / 2 ] for k = 1, 2. For these values of p\ and p 2 we have 


1(f )« v k (f) = h[f(± (l + (-l)^- 1 / 2 )) - 


(—l) fe 3 -1 / 2 


if(h)~f( 0)} 


If we take the arithmetic mean of both of these approximations, we obtain the two- 
point Gaussian rule. The above basic rule 14 (/) leads to the following compound 
rule for k = 1,2: 


n— 1 


V w (f)=h [ Y,f( ih + 2<1 + (—US" 1 / 2 )) - \ (—US” 1 / 2 {f(nh) - /(0)} 

(3.5.8) 


i=0 


The third Peano kernel of 14 is given by 




L r(-l) fc 3“ 1 / 2 | - d if 0 < X < Ul + (—l) fc 3 -1 / 2 ), 

6 2 

k ^2^[(2 + (-l) fc 3- 1 /2)/ l _ 2a; ] if%(l + (-l) k 3-W)<x<h, 


and for k = 1, 2 we have 


r K*{x)dx={- 1 )' 

Jo 


h 4 V3 

216 


(3.5.9) 


Since (—l^iTf(x) > 0 for x G (0, h), we find from (3.5.9) that the error in the 
compound rule (3.5.8) is 

h 3 b 

1(f) - V k , n+2 (f) = (-l)^- 1 / 2 — /"' (0 fc ), G [0, /i], fc = 1,2. (3.5.10) 
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If (—1 ) k f'"(x) > 0 for al x £ [0, h], then (3.5.10) yield 


(-1 ) fe U„ +2 (/) < (-1 )*/(/) < (-1 )Ti,„ + 2 (/) for k = 1,2. (3.5.11) 

When successively halving the step size, the left and right side of the inequality 
(3.5.11) increase and decrease. Since this monotone behavior holds for a wide class 
of quadrature rules, we define it for an arbitrary basic quadrature rule Z(f): 

n 

Z(f) = » Ae[a,&], (3.5.12) 

i =0 


which is exact for / £ V s -\> Denote the associated compound rule with respect to 
the step size h by Zh(f) and define 


Z 


h/2,h ( X ) — ^h/2 


(t-xf + l - 


L (s — 1)! 


-Z h 


(f - x) + 


S — 1 


L (5-1)! J’ 


(3.5.13) 


where (t — x)+ 1 


(t — x) s 1 if t > x, . 

. Then, if / £ C s a, b , we have 
0 if t <x L J 


r b 

Z h / 2 (f) - Z h (f) = / UA) Z fc/2)fc (o;) dx. (3.5.14) 

J a 

Hence, we conclude that if f"'(x) < 0 for all x G [a, b], then 

Vi , 3 (/) < V,4(/) < v, 6 (/) < • • • < 1(f) < ■< v 2fi (f) < V 2A (f) < V 2 ,3 (/), 

(3.5.15) 

and if f"(x) > 0 for all x € [a, b\, then 


V 2t3 (f) < V 2A (f) < V 2t6 (f) < ■■ ■< 1(f) < ■■■< V lfi (f) < V 1A (f) < V h3 (f), 

(3.5.16) 

Example 3.5.1. (Schmeisser and Schirmeier 1976) Consider J_ 1 e~ x dx = 

2 Jq 1 e -x2 dx. Since the third derivative of the integrand is positive on [0,1], we get 
the following monotone bounds. 


Table 3.5.1 


n 

v 2 , n 

v hn 

4 

1.4878637 

1.4993485 

6 

1.4929523 

1.4943389 

10 

1.4935622 

1.4937340 

18 

1.4936375 

1.4936589 

34 

1.4936468 

1.4936496- 
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Table 3.5.2. Gaussian Quadratures: f w(x) f(x) dx = w k f ( x k) + E n . 

k =1 


Weight Interval Nodes Nodes Weights Error Coefficient 

w(x) (a, b ) are zeros of x k w k K n 


1 (-1,1) P n (x) 


See Table A.6 


e x (0, oo) L n (x) 


See Table A.7 


1 

y/l — X 2 
\/l — X 1 


1 — X 2 


1 


1 + X 
1 

yfx 

\fx 


(— oo, oo) 

H n {x) 

See Table A.8 

(-1.1) 

T n {x) 

(2k — 1)7r 

cos - 

2 n 

(-1,1) 

(0,1) 

U n (x) 

^2n+l(\/^) 

yfx 

k7T 

cos - 

n- 1-1 

9 (2k — 1 ) 7 r 

cos —:-— 

An + 2 

(o.i) 


2/C7T 

COS 2n + 1 

(0,1) 

P2n(Vx) 

«) 2 

(0,1) 

Pln+liVx) 

\fx 

( 4) 2 


_-2_ 

(n + l)P n+1 (x k )P^(x k ) 
(n\) 2 x k 

i.n+1) 2 Ll +1 (x k ) 

2 rt - 1 n! % /7r 

n 2 H l-\ ( x k) 

7r 

n 

7r 9 b 

-- sin -- 

n + 1 n + 1 

27r 9 (2k — 1)7r 

-cos - 

2n 4-1 4n + 2 

47T . 2 ^ 

2n 4-1 Sm 2n + 1 

2 h k 

2 h k (x^) 2 


2 2n+1 (n!) 4 
(2n + 1) [(2n)!] 3 

M! 

(2n)! 

(n!) y5F 
2 n (2n)! 

27T 

2 2n (2n)! 

7 r 

2 2n + 1 (2n)! 

7T 

2 4n+1 (2n)! 

7 r 

2 2n (2n)! 

2 4n+1 [(2n)!] 3 
(4n + 1) [(4n)!] 2 
2 4n+3 [(2n +1)!] 4 
(4t7 + 3) [(4ti + 2)!] 2 (2n)! 


Here, the error E n — K n f^ 2n \£), a < £ <b. Also, x£ denotes the A'-th positive zero of Phi i x ) or ftn+iW of the 
previous column, and h k denotes the corresponding weights for x£ in the Gauss-Legendre formula (w(x) = 1). 
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3. GAUSSIAN QUADRATURE 


3.6. Gaussian Rules for the Moments 


The formula for the Gaussian moments is 

nl 


r 1 

/ x k f(x) dx = N' Wi f (xi) + R 

Jo i =i 


(3.6.1) 


3.6.1. Gauss-Jacobi Moments. Formula (3.6.1) yields the Gauss-Jacobi 
rule, when it is used with the polynomials 


Qn 


= \Jk + 2n + lP n (fc,0)(l — 2x), 


where P n (k, 0)(x) are the Jacobi polynomials, the quadrature point X; L is the i -th zero 

r n—1 -i —1 


of q n ; the weights are given by Wi = 


Rn = 


n\ (k + n)\ 


i 2 


U)] 

l=o 

/ (2n) (4> 


, and the remainder is 


r, 0<e<i. 


(k + 2 n)l J (k + 2n + l)(2n)! ’ 

The points and weights Wi are available in Abramowitz and Stegun (1968, p. 921). 
For nodes, see gaussmoments .nb on the CD-R. 

3.6.2. Gauss-Legendre Moments. There are two cases. 

Case 1. The Gaussian rule (3.6.1), when used with the polynomials 

(1 - x)~ 1/2 P 2n+ i(Vl -x), P 2n + l(l) = 1, 
where P n (x) are the Legendre polynomials, yields the rule 

r 1 n 

f(x) y/1 - X dx = ^ Wi f (Xi) + R n , 
i=l 


f 

JO 


where the quadrature point Xi = 1 — , where ^ is the i-th positive zero of P 2 n+i (%); 

the weights are given by = 2<f 2 w^ n+1 \ where rc 2n+1 are the weights of order 
2n + 1, and the remainder is 


Rn = 


2 4n+ 3 [( 2n + 1)!]4 


■/ ( 2 n) u>, o<e<i. 


(2n)!(4n + 3)[(4n + 2) !] 2 
Case 2. Using the polynomials P 2 n (Vl — x), P 2 n (l) = 1 , we have 
* fix) 

- ax = 

r 

i =0 


f -4==dx = y2lVif (Xi) + Rn, 

Jo V -1 - X “ 
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where the quadrature points are Xi = 1 — & being the z-th zero of P2n(%)\ the 

weight Wi = 2wf n ^, where are the weights of order 2n, and the remainder is 


R 


n 


2 4n+1 [(2n)!] 3 (2n) 

(4n + 1) [(4n)!] 2 J 


0 < £ < 1 . 


3.6.3. Gauss-Legendre Moments on an Arbitrary Interval. There 
are two cases. 

Case 1. Formula (3.6.1), when used with the polynomials 
(1 - x)~ 1/2 P 2n +i(Vl -x), P 2n + i(l) = l, 

where P n {x) are the Legendre polynomials, yields the rule 

pb _ n 

/ f(y) \Jb-ydx = ( b-df 1 2 Wj f {tg) + R n , 

J CL • i 


where the quadrature point Xi = 1 — <f 2 , ^ being the z-th positive zero of P^n+i (t); 
the weights are given by Wi = 2<f 2 w^ 2n+1 \ where rc 2n+1 are the weights of order 
2n + 1, and the remainder is 


R 


n 


(b — a) 2n+1 2 4n+3 [(2n+l)!] 4 (2n) 

(2n)!(4n + 3)[(4n + 2)!] 2 


0 < £ < 1 . 


Case 2. Related to the polynomials P2n(Vl — x), P^n — we have 


/ 


/(y) 

V&-y 


dy = \/b — i 


n 

^ ~2,Wif(Vi ) + -Rn, 


where yi = a + (6 — a)xu the point Xi = 1 — <f 2 , where ^ is the z-th zero of P2n{%)\ 
the weights are Wi = 2wf ,n \ where w^ 2n ^ are the weights of order 2 n. 

3.6.4. Gauss-Chebyshev Moments. Related to the orthogonal polynomi¬ 
als —= T< 2 n+i ), we have 




where the quadrature points are a: j = cos 2 ——; the weight s arc w t 


2i r 


and the remainder is 


Rn = 


(2n)\2 4n + 1 


2(2n + 1)' 

/ ( 2 Ua o<e<i. 


2n 1 
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3. GAUSSIAN QUADRATURE 


3.6.5. Gauss-Chebyshev Moments on an Arbitrary Interval. Re¬ 
lated to the orthogonal polynomials —= T 2n xi (y/x), we have 

V x 


f 


/(*) 


dx = (b - a)^Twi f (yi) + R n , 

i=l 


_ \)tv 

where the quadrature points are = a + (b — a)xi, with Xi = cos 2 —+T) ’ 

weights are the same as in §3.2.7. 

3.6.6. Weights and Modified Moments. Piessens (1987) has classified 
the following 18 types of weight functions w(x) and provided the related recurrence 
relations for the computation of modified moments, which are defined by M n = 
w(x) T n (x) dx, where T n (x) are the Chebyshev polynomials of the first kind 


(see Gautschi 

1970, 

and Table! 

3.6.1 on pages 151-159). 


1. wi(x) 

= (1 

— a;)“(l + 

x) 13 , 

a,f3>- 

-i, 


2. w 2 (x) 

= (1 

-x) a (l + 

xfe~ 

ax , a„ 

8 > -1, 


3. w 3 (x) 

= (1 

-x) a (l + 

xf\n 

(T) 

1 e~ ax , a 

>-2,p> 

4. w±{x) 

= e~ 

ax 2 

1 





5. w 5 (x) 

= (1 

-x) a (l + 

x)®e~ 

a(x+ 1) 2 

5 

a, (3 > — 

1, 

6. wq(x) 

= (1 

-x) a (l + 

x)®e~ 

a/(x+ 1) 

a, (3 > - 

1, 

7. wr(x) 

= (1 

-x) a (l + 

xfe~ 

a/x 2 



8. w 8 (x) 

= (1 

-x) a (l + 

xfe~ 

a/(x+ 1) 2 

5 

a,/3 > ~ 

-1, 

9. Wg(x) 

= (1 

-x) a (l + 

xf\n 

(T) 

a,{3> 

-1, 


10 , 


wio(a;) = (1 -a;) a (l + a;) /3 ln (^-^) In a,/? > -2, 


'1 — 


11. wn(x) = \x — a\ a , a > — 1 and \a\ < 1, or a arbitrary and \a\ > 1, 

12. w\ 2 {x) = \x — a\ a sgn(x — a), a > —1, 

13. wis(x) = \x — a\ a In \x — a|, a > —1, 

14. wi 4 (x) = \x — a\ a In \x — a | sgn(x — a), a > —1, 

15. wis(x) = (1 — x) a (l + x)P \x — a| 7 , a > —1, 

16. w\q(x) = (1 — x) a (l + x)P \x — a| 7 In \x — a|, o > —1, 

17. ici 7 (x) = [(x — 6) 2 + a 2 ] a , a > —1, 

18. wis(x) = (1 + x) a J„ ( a(x + l)/2), a > —1, 

where a is real or complex. The modified moments are presented in Table 3.6.1. 
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Table 3.6.1. Table of Modified Moments. 


Weight Modified Moments (RR) 


1. w\ (x) RR is (a 4- (3 + n 4- 2) M n +\ 4- 2(a — /?) M n 4- (a 4- /3 — n 4- 2) M n -\ = 0, 
with M 0 = 2 q+ ^ +1 B(a + 1 ,P + 1), M x = ^~ Q „ M 0 . 


Explicit: = 

CO 

M n ~ ^ /?) c(a -f A:) n _2 ^° f+fc+1 ) 


a 4- /3 + 2 


n,-n, a + 1 

L a + P + 2 ’ 


k =o 


+(-l) n E afc(/?,a)c(^ +A:)n 2 (^+ fc + 1 ) j 


fc=o 


c(a) = cos ((a + l)7r) T(2a +2), a 0 (a,/?) = 2 /3 a , 

2 

) 

2ap 


a 1 (a, / 0 ) = - a + 2/? + 2 2^- 2 


a 2 (a, /?) - ^ + Y + ^ + P + ?) 2/3_Q " 5 - 

For a = /3: RR is of order 1. 

For a = 0: RR is 

(n - l)(n + P + 1) M n + n(n - p - 2) M n _i = -2^ +1 . 


Stability 
FR stable for 

a < (3 and integer, 

or a > (3 and (3 ± ^+integer. 


FR is stable. 


2. W 2 {x) RR is — M n +2 — (n + a 4- /3 + 2) Af n _j_i — (2a — 2 f3 4- a) M n 

+(n — a — (3 — 2) M n _i 4- - M n -2 = 0. 

Continued over next 8 pages. 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight Modified Moments (RR) 


Stability 


For a = 0: RR is -aM n+l + (2/3 + 2n + 2 - ——— M n 

n — 1 

( n n (j8-fl-a)(n-f 1)\ an __ 

+ 2a-/J-l-^ - ^M M n _i +--M n _ 2 

V n—1 ) n—1 

2 /3+ 2 e -l 


n — 1 ’ 

Mo = <7i, Mi = ^2 - <7i, M 2 = 2*73 - 4<72 + /i, 
where q n = e~ a T(a + n) P(a + n, 2a) a _Q_n . 

For a = (3 = 0: RR is 

~rr\ M n+l - 2M n - -±- M n -i = [e~ a + (-1)” e a ]. 

n -f 1 n — 1 n z — 1 

For a = iu, where u is real, RR for M n = cos(cux) T n (x) dx is: 

c j 2 (n — l)(n — 2) M n+2 — 2 (n 2 — 4) (a; 2 — 2n 2 + 2) M n 

+a; 2 (n + l)(n - 2) M n _ 2 = 24a; sina; — 8 (n 2 — 4) cosa;; 

and RR for M n = f_ x sin(o;£) T n (x ) dx is: 

o; 2 (n - l)(n - 2) M n+ 2 - 2 (n 2 - 4) (a; 2 - 2n 2 + 2) M n 

+uj 2 (n + l)(n — 2) M n _ 2 = —24a; cosa; — 8 (n 2 — 4) sina;. 


FR and BR unstable, 

Lozier’s algorithm needed, 
see §3.6.7. 

Lozier’s algorithm needed. 

Lozier’s algorithm needed. 


3. w 3 (x) RR is ^ M n+2 - (n + a + /? -f 2) M n+1 - (2a - 2(3 + a) M n 

+(n — a — (3 — 2) M n _i -f - M n _ 2 = / n +i — 2 I n + / n -i, 

where / n = W 2 (x ) T n (x) dx. 

M n ~ e -a [—2 a- ^ -2 c(/3 + 1) n -2 ^ 3-4 + • - ■] 

+(—l) n e a [2^ _a+1 c(a) P n (a) n _2a ~ 2 H-], where 

c(a) = cos ((a + l)7r) T(2a + 2), P n (a) = ip(2a + 2) — ln(2n) — — tan(7ra). 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight 

Modified Moments (RR) 

Stability 

4. w^(x) 

RR is a(n — 1 ) M n + 2 + 2(1 — n 2 — a) M n — a(n + 1 ) M n _ 2 = 4e _ °, 
where M n = 0 for odd a, and Mo = y'V/a erf(ya). 

M n ~ e~ a [ 2 a " 2 + 2 ( 6 a - 1 ) a " 4 - 2(60a 2 - 60a + 1 ) a " 6 + • • •]. 

FR unstable, 

Use Lozier’s algorithm. 

5. w 5 (x) 

RR is a M n _|_3 H- 2a A 
— [a + 2(o: + /3 + 2 
For a = 0, the order < 

M 0 - 2“+' 3+1 2 F 2 

^n +2 — [a 4- 2(a + /3 + 2 4- a)] M n +i — 4(a 4- a — /?) M n 
\ — a)] M n _i 4 - 2a M n _ 2 4 - a M n _3 — 0. 

Df RR is reduced; we have 

'/? 4-1 /3 4- 2 Q + /3 + 2 Q + /3 + 3 1 

2 » 2 * 2 ’ 2 ’ 

6 . w 6 (x) 

RR is (a + /? + 3 + n ) M n +2 "I - 2 (g - 1 - 2 a "I - 2 - 1 - ti) M^x-i-i + 2(3a — P — 2 d -I- 1 ) A 'I n 
+2(a + 2 a + 2 — 7 i) M n _i + (a + /? + 3 — n) M n _ 2 = 0; 

M 0 {a,p,a) = 2 a +0+'e~ a / 2 r (a + 1 ) l/(a + 1, -p,a/2), 

Mi(a,P,a) = -M 0 (a + l,P,a) + M 0 (a,P,a), 

t~. 0 _ (/?-3a + 2a-l)M o (a,j0,a)-2(2a + a + 2 )M 1 (a,/?,a) 

FR and BR unstable, 
use Lozier’s algorithm. 


ri u y — 

a + /3 + 3 


7. w 7 (x) 

RR is (a -L /3 4- 5 + a) M n _|_4 + 2(a — /3) M n +3 

+ [4(a + (3 + 2 + 2a) + 2a] A / n + 2 + 6 (a — /3) M n +i 

+ [ 6 (a + /? + 1) — 16a] M n + 6(q — /?) A / n — l 

-f- [4(a + (3 + 2 + 2a) — 2a] M n _ 2 + 2(a — /3) M n _3 4 - 6 (a — /?) M n _ 1 

+(a 4 - (3 4 - 5 — a) M n _4 = 0. 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight 

Modified Moments (RR) 

Stability 

8 . w 8 (x) 

RR is (q 4~ + 4 -|- ti) + 2(3 ot — (3 - 1 - 6 4 * 2ti) Af n _|_2 

+(15a — (3 4 - 12 -f 8 a 4 - 5n) M n +\ + 4(5a - (3 4 - 2 — 4a) M n 
-h(15Q — (3 8 a — 577 ,) M n —\ 4 * 2(3q + (3 -K 6 + 2ti) M n —2 
+(a 4- (3 4- 4 — n) Af n _ 3 = 0. 


9. Wg(x) 

RR is (a + /3 + n 4- 2) M n +\ + 2(c* — /3) Af n 4- (q + /3 — 71 + 2) M n —i 

= 2 / n — / n _|_i — I n — 15 

where/„ = /^(l - x) Q (l + x)^T n (x) dx. 


10 . iuioOe) 

RR is (q 4- (3 + tl 4- 2 ) M n +\ 4- 2 (q — / 2 ) M n 4 * (c* 4 ~ (3 — 71 + 2 ) Af n _i 
— 2 if n — iJ n -fi — H n —i — 2G n — G n+ i — G n - 1 , 

where H n = f* 1 ( 1 - x) a (l 4 - x)& In T n (x) dx , 

FR stable 


and G n = /^(l - x) Q (l + x)^ In (^-t£) 2 n(x) dx. 

~ A n (a,f3) + (-l) n A n (P,a), 

where A n (a ,/?) = 2 / 3 _Q_ 1 C(a + 1) P n (a 4 - 1 ) n~ 2a ~ 4 

- 2/? 3 Q 4 C(a + 2) [(2 q + 6/3 + 3) P n (a + 2) + 1] n~ 2a ~ 6 + ■■■, 



C(a) = cos( 7 ra) T(2a 4 - 2 ), P n (a) = ip(2a + 2 ) - ln 2 n - ^ tan( 7 ra); 
M 0 = 2 Q +^ + 1 P(a + 1 , (3 + 1 ) [ (ip(a + 1 ) - V>(a + /? + 2)) 

- (V>(/? + 1 ) - + P + 2) - ^(a + P + 2 )) ], 

Mi = M 0 (a,P + 1) - Mo(a,(3). 

where ip(x) is the psi function and B(x,y) the beta function. 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight Modified Moments (RR) 


Stability 


ll.wu(x) RR is + 

V n +1/ \ n + 1/ 


a + T 


[(1 — a) Q+1 — (—l) n (1 4- a) Q+1 . 


1 — n 2 

For \a\ < 1 and a > — 1, we have 

oo 

M n ~ (-l)* r+1 (2 k + 1)! [rjfc(a) 4- (-l) n r fc (-a)] n~ 2k ~ 2 

k=0 

OO 

4-2 22 s 2 k cos(narccosa) cos ((a + 2 k + l)7r/2) T(a 4- 2k + 1) n _a_2A:_1 

k=0 

oo 

—2 ^ $2fc+i s i n ( n arccos a) sin ((a + 2H 2)7r/2) T(a 4- 2/c 4- 2) n~ a ~ 2k ~ 
k =o 

where ro 


FR stable 


SO = (1 - a 2 ) {a+1)/2 , Sl = o(l - f) (1 - a 2 ) a/2 ; 

Mo = ^tt [( 1 -«) Q+1 + ( l + a ) Q+1 ]. 

Mi = ~T~n K 1 - «) Q+2 + (!+ «) Q+2 ] + a M 0 , 


M 2 


Q + 2 
2 

a + 3 


[(1 - a) Q+3 + (1 + a) Q+3 ] + 4a Mi - (2a 2 + l) M 0 . 


5 2005 by Chapman & Hall/CRC Press 


3.6. GAUSSIAN RULES FOR THE MOMENTS 155 



Table 3.6.1. Table of Modified Moments, Continued. 


Weight Modified Moments (RR) Stability 


12. Wi 2 (x) RR is the same as for wn(x). 

For |a| < 1 and a > —1, we have 

oo 

M n ~ E(-l) fc+1 (2fc+l)! [r fc (o) + (-l) n r*(-a)] n~ 2k ~ 2 

k= 0 
oo 

+2 2 s 2k sin(narccosa) sin ((a + 2 k + l)7r/2) T(a + 2k 4-1) n~ Q ~ 2k ~ l 
k= o 

oo 

2 ^2 S 2 k+i cos(n arccos a) cos ((a + 2k + 2)7r/2) T(a + 2k + 2) n ~ a ~ 2k ~ 2 
fc=0 

where and are the same as in wn(x ); and 

Mo = “"TT [(l-«) Q+1 -(l + «) a+1 ]. 

Mi = —[(1 - a)<*+ 2 - (1 + a)“+ 2 ] + a Mo, 
a 4- z 

M 2 = — f(l - a) Q+3 - (1 + a) Q+3 l + 4a Ml - (2a 2 + l) M 0 . 
a + 3 J 


13.tui 3 (:r) RR is (n - 1 )(n + a + 2) M n+1 - 2a (n 2 - l) M n + (n + l)(n - a — 2) M n _ x 
= 2(—1 )"(a + 1) Q+1 ln(l + a) - 2(1 - a) a+1 ln(l - a) 

-(n - l)/„+i + (n + 1) J„_i, where /„ = f* 1 \x - a\ a T n (x)dx; 

Mo — P(a,a) + P(a, —a), 

Mi = aP(a, a) + aP(a, —a) + P(a + 1, —a) — P(a + 1, a), 

M 2 = 2P(a + 2, a) + 2P(a + 2, -a) + (2a 2 - 1) [P(a, a) + P(a, -a)] 
+4a [P(a 4- 1, -a) - P(a + 1, a)], 

where P(a, a) = ( 1+a ) Q+1 i n (! + a ) + a )° +1 


a + 1 


(a +1) 2 


FR stable for |a| < 1. 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight 

Modified Moments (RR) 

Stability 

14. w 14 ( 2 ) 

RR is (n - l)(n + a 4-2) M n+ i — 2 a ( n 2 — l) M n + (n + l)(n — a — 2) M n _ 1 
= (n + 1 ) / n _ 1 - (n - 1 ) / n+ i 

— 2(1 — a ) a+1 ln(l — a) — 2(1 + a ) a+1 ln(l + a), 
where I n = \x — a\ a sgn(x — a) T n (x) dx , 

and the starting values are similar to those for 1 ^ 13 ( 2 ;). 

FR stable. 

15. wis{x) 

RR is (a + /? + / y + 3 + fi) M n +2 + 2 [(1 — a)(c* + 1) — (1 + a)(/3 + 1) — an] M n +\ 
+2 [(1 — 2 a)(a + 1 ) + (1 + 2 a)(/? + 1 ) — (7 + 1 )] M n 
+2 [(1 — a)(a + 1) — (1 + a)(/3 4 - 1) 4 - an] M n _j 
+(a 4-/34-74-3 -n) M n _ 2 = 0; 

M 0 = 7(0;, ( 0 , 7 , a) + J(( 0 ,a;, 7 , -a), 

Mi = a M 0 + J (7 + 1 , (0, a, -a) - J (7 4-1, a, /3, a), 

-1 

FR stable. 


M 2 = - +jg + 7 + 3 I 2 K 1 - «)(/? + 1 ) - (1 - <*)(« + 1)1 M 

[(7 + 1 ) - (1 - 2 a)(a 4 - 1 ) - (1 4 - 2 a)(/? + 1 )] M 0 }, 
where J(a,/?, 7 , a) 

= 2“(1 + a)^ +7+1 B(/3 4- 1 ,7 + 1) 2 F 1 (-a, /? + 1; 7 + /? + 2; (1 + a)/2). 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight Modified Moments (RR) 


Stability 


16. w 16 (x) 


RR is 

(a + /? + 7 + 3 + n) M n+2 4 - 2 [(1 - a)(a 4 - 1 ) - (1 4 - a)((3 + 1) - an] M n +i FR stable. 
+2 [(l — 2a)(a + 1) + (1 4 - 2a)(/3 4- 1 ) — (7 4 - 1)] M n 

4-2 [(1 — a) (a + 1) — (1 4- a)(/3 4- 1) 4- an] M n _i + (a4-/34-7~b3 — n ) M n -2 
= 2 I n - /„+2 - 2 , where I n - f\(l - x) a (l + x) p \x - a\' r T n (x)dx. 


17.» 17 (x) RRis g + ^±L)M n+ 2 - 6( 1 + ^±j)M „ +1 

+ (o 2 + 6 2 + i + ^ 5 ) M„ - 6 (l + 2±i) M„-i 


(1 «tl\ (a 2 + (1 - 6) 2 )“ +I + (—l) n (a 2 + (1 + b) 2 )“ +1 

\4 + 2(1 =nj) M - 2 = --' 


1 n r 1 / 1 — & 1 + fc\ 

bor a = — 1 , Mo = - ( arctan-b arctan- , 

a \ a a J 

1 , a 2 + (1 - 6) 2 

M 1 -6M 0 +-ln a2 + (i+6)2 , 


M 2 = 46Mi - ( 2 a 2 + 26 2 + l)M 0 + 4. 

|a| 


For 6 = 0 , we have Mq = < 


-2 In 


1 + Vl + a 2 


if a 


l 

' 2 ’ 


2 1 

— arctan- 
a a 


if a = - 1 , 


(1 4- 2 a) Mi (a) = 2 (l 4- a 2 ) a 4- 2 aa 2 M 0 (a - 1 ), 

(3 4- 2 a) M 2 (a) = 4(1 + a 2 ) Q - (3 4 - 2 a 4 - 2 a 2 ) M 0 (a). 


FR unstable 
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Table 3.6.1. Table of Modified Moments, Continued. 


Weight 

Modified Moments (RR) 

Stability 

18. u>i8(z) 

RR is ^ M n+ 4 + [(n + 3)(n + 3 + 2a) + a 2 - v 2 - ca 2 /4] M n+2 

+ [4 {y 2 - a 2 ) - 2(n + 2)(2a - 1)] M n+1 
— [2 (n 2 — 4) + 6 (i/ 2 — a 2 ) - 2(2a — 1) - 3w 2 /8] M n 

+ [4 \u 2 - a 2 ) + 2(n - 2) (2a - 1)] M„_ 1 

FR stable for very large \a\. 

For small |a| use 

Lozier’s algorithm, with 

6 initial values and 2 end values. 


+ [(n - 3)(n - 3 - 2a) + (a 2 - v 2 - u> 2 /4)] M n _ 2 + ^ M n _ 4 = 0, 

where Mo — G(w, v ,a), Mi = 2G(w, 1/,a + 2) — G(w, 1/,a), 

A/ 2 — 8 G(cj, z/, q + 2) — 8Gr(cj, z/, q + 1 ) + G(cj, z/, q), 

M3 = 32G(k;, z/, a + 3) - 48G(ti;, z/, a 4- 2) 

+18G(ti;, z/, a + 1) — G(a;, z/, a), 
where G(cj, v , a) = f* x a J v (u)x) dx. 



M n ~-Ij n ( w )n- 2 



+(—l) n 2 -3 " -2Q-1 t cos ((a + 1 )jt) r(2a + 2) n~ 2a - 21 '- 2 . 



Notes. 1. If we set f n = 3 F 2 


, then, using Fesenmeyer’s technique (see Rainville 1960), 


n, —n,a + 1 
L^,a + /3 + 2’ 

we obtain the recurrence relation (a + (3 + n + 2) f n +i + 2(a - P) f n + (a + P ~ n + 2) / n _i = 0, 

u-u-ij/ i * P — a j. 2(a —/3) 2 (a-F/3 + 1) 

which yields / 0 = 1 , /i = —-- - , n > h = 


a + /? + 2’ (a + /? + 2)(a + /? + 3) (a + /? + 2)’ 

2. In u;6(^), page 156, I/(a,/?, a) and Mo(a, /?, a) are Rummer’s confluent hypergeometric functions. 
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3. GAUSSIAN QUADRATURE 


These modified moments are presented by their respective recurrence relations 
(RR’s) for the types of weight functions w\(x) through i 8 (x); under ‘stability’ it is 
noted whether the forward recursion (FR) or the backward recursion (BR) is stable; 
and asymptotic expansions of M n as n —» oo are given. 

Notes: (i) The modified moments for w\(x) are useful in computing integrals 
of the type $^(b — x) a (x — a)P f(x) dx which have algebraic endpoint singularities 
(Piessens and Branders 1973, and Piessens, Mertens and Branders 1974). 


(ii) The modified moments for W 2 (x) for a = iuo are useful in computing the 
Fourier coefficients J ^ cos(cjt) dx (Piessens and Branders 1975), and for constructing 

the Gaussian quadrature formulas for J ^1 + | | ^ f(x)dx. 

(iii) The starting values for the modified moments of wj{pc) and wg(x) are not yet 
known and further study is needed. 

(iv) Stating values and applications of wg (x) are available in Piessens and Branders 
(1973). 


(v) The computation of integrals in the modified moments for w is(t) is available 
in Luke (1962). 


3.6.7. Lozier’s Algorithm. (Lozier 1980) This algorithm concerns the 
problem of computing solutions to recurrence relations of second and higher orders. 
For a numerical solution to be stable, it is necessary to determine the relative rates of 
growth that can be exhibited by solutions, and to set boundary conditions accordingly. 
Details and some examples can be found in Lozier (1980) and Wimp (1984). 


3.6.8. Values of the Moments M n for the Weight Function w\(x). The 
following table gives the exact values of M n (a,/?) for a = 1.1 and (3 = —0.4 
(Piessens and Branders 1973). The relative in the third column is in single precision 
computation. 


n 

Values of M n (l.l, —0.4) 

Relative Error 

0 

3.27778944(0) 

4.0(—7) 

10 

—5.1022612(—2) 

3.1(—6) 

20 

—2.2090810(—2) 

4.0(—6) 

50 

—7.3428042(—3) 

1.3(—5) 

100 

—3.1951796(—3) 

2.7(—5) 

200 

—1.3906742(—3) 

4.5(—5) 

300 

—8.5488856(—4 

7.2(—5) 
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3.7. Finite Oscillatory Integrals 


The transformation x = -—- y + ^ ^ a = m y + c reduces the integral I^(wf) to 


m 


J w(my + c) f(my + c) dy. 


For ic(t) = sin(fcr) or ic(t) = cos(fcr), we have 

f cos(mty) cos(ct) — sm(mty) sin(ct), 
w (my c) = \ 

\ sin (mty) cos(ct) + cos(mty) sin(ct), 
which yields in each case two integrals of the type 


K 


f 1 f cos / 

/ . ( Ty)F(y)dy , 

J-i l sin 


(3.7.1) 


(3.7.2) 


(3.7.3) 


where iT is either sin(ct) or cos(ct), T = tm , and F(y) = f(my + c). 

3.7.1. Filon’s Formulas for Trigonometric Functions. Let a = To < 

Ti < ... < T 2 n = b, and fk = f (%k)- There are two formulas: 

rx 2n r 

/ /(a:) sin(ta) dx ^ h a{9) {/ 0 cos (te 0 ) - hn sin (tx 2n ) } 

Jxn L 


+ m S2n + 7 (0) S 2 „-i + 45 thA CL-i 




f 


(3.7.4) 


f(x) cos (tx) dx^h |ja(6>) {f 2n cos (tx 2n ) ~ fo sin (tx 0 ) } 

2 


-mC2n+7(0)C 2n -1 


■ th 4 5/ 


45 


2n—1 


Rni 


(3.7.5) 


where 0 = th , and 

n 

s 2n = 22 sin ( te2fe ) “ 5 [/2n sin (ta 2n ) + Zo sin (ia; 0 ) ] , 

fc =0 

n 

S2n-1 = ^ / 2 /C -1 sin (to 2 fc-l) , 
fc=l 
n 

C 2 n = 22 f 2k C0S ( te 2fc) - \ [f2n COS (tx 2n ) + fo COS (te 0 ) ] , 
k =0 
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C*2n— 1 = ^ /2/c-l COS (tx 2 k- 1) , 


k =1 


^2n-l =^2f2k-l Sin(^ 2 fe-l) , 


fc=l 


<?2n-l = X)/2fe-l COs(fo 2fe _i) 
fc=l 

to = 4 nh5 f (4) (& + , 

1 sin 2# 2 sin 2 # 

a(,,)= « + ^—p-' 

1 + cos 2 0 sin 26 


m = i( e , 

1 («)=4( Sin '' “ s 


9 3 




0 2 


1 


For small 6, we have 


26> 3 

29 5 

29 1 


45 

~~ 315 

4725 

2 

20 2 

46» 4 

1 

2(9 6 

3 + 

TT ~~ 

105 

567 ~~ 

4 

29 2 

1 

# 4 

9 6 

3 ~ 

1^ + 

210 _ 

11340 


7 = 


If f(x) is approximated linearly in each subinterval, we have an equivalent form (due 
to Clendenin 1966) 

r%2n 

sin tx dx = Si + S 2 , (3.7.6) 


px 2n 

/ /to sir 

Jxo 


where 


71 — 1 


Si = V sin tX2k, 

k =1 

rcos(too) 


S 2 =/o 
4 


t 


— z cost(xo + ft/2)J -\-f 2 n 
th' 


cos(to 2n ) 


+ z cost(xo + ft/2) 


kh. 


4 . o z . /m\ 

! ' = M5 Sm IT)’ i= S5 8m (¥)' «='''» + 

Note that we can use the Lagrangian representation to generate the formula for l\ (/), 
that is 

/ bn n 

£ 0U) / (a;,-) dx + E n =Y J C n j f to) + to, (3.7.7) 
i=o j=o 
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where 


pb pb 

C'n,j — j ( t ) dx — / 

J a J a 


(x-x 0 )...(x- Xj-i) (x - x j + i) ,..(x-x n ) 
(Xj -Xo)... (Xj - Xj- 1 ) (Xj - Xj+i) ... (Xj - x„) 


Xr, 


E(-D 


n—k 


k =0 


b k+1 - a k+1 
k + 1 


fc), 


(3.7.8) 


where X n j = {pcj—xf)... (xj — Xj-i) (xj — Xj+f)... (xj — x n ), and the expres¬ 
sion cr(j, n,n — k) denotes the sum of all possible different products of n quanti¬ 
ties x$,x\,... ,x n taken (n — k) at a time. Applying formula (3.7.7)-(3.7.8) to 
fa f(x) cos(tx) dx and J ^ f(x) sin (to) dx, we find that 



f h 

cos t(a + ih) / f(a + ih + £) cos(££) 

Jo 


f h 

— sin t(a + ih) / f(a + ih + £) sin(t£) 

Jo 


= cost(a + ih) ^ f (a+ ih + £j) 
j=o 


— sint(a + ih) ^ (7®^ / (a + i/i + £j), (3.7.9) 

j=o 



sin (to) dx 


sint(a + ih) ^ C^°j f (a + ih + £j) 
j =o 


— cos t(a + ih) ^ / (a + i/i + £j), (3.7.10) 

j=o 


where h = 


(6 — a)/(n + 1), x = a + i/i + £, = j/i/n, and 

07 = E(-l) n “T! <x(j, n, n - fc) 

fc=0 

k tk—p 1h 

»« + W2)j o . 


1 n 

07 = E(- 1 )”“ fcfc! 01 n ’ n - fc ) 

fe=0 

' fe ^ ck-p l h 

[Z(k-py.t^ “«f+W2)j o , 

-Oj = (£j ~ £o) • • • (£j — £j-l) (£j — Cj+l) • • • (£j — Crt) • 


(3.7.10) 


(3.7.11) 

(3.7.12) 
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The coefficients for the Filon’s quadrature rule are given in Table A. 15 for 6 = 
0 . 0 ( 0 . 01 ) 0 . 1 ( 01 ) 1 . 0 . 

Example 3.7.1. Compute / = f* e x cos txdx fort = 1,10,100,1000,10000 

, i e (cos t +1 smt) t t 1 

and n < 10; this has the exact value---. The results are given m Table 

“ 1-K 2 5 

3.7.1, which shows slow convergence and the loss of accuracy for higher values of t). 

Table 3.7.1. 


t 

Approximate Value 

Exact Value 

1 

1.87802 

1.37802 

10 

—1.68999(—1) 

—1.789(—1) 

100 

—1.35287(—2) 

—1.36287(—2) 

1000 

2.24922(—3) 

2.24822(—3) 

10000 

—8.31005(—5) 

—1.83282(—3) 


3.7.2. Use of Chebyshev Polynomials and Bessel Functions. If 

we fit f(x) by a series of Legendre polynomials, then we can obtain formulas for 
integrals of the form T^(x) sin (tx) dx or T^(x) cos (tx) dx, as suggested by 
Bakhvalov and Vasileva (1968). Thus, 


UL ok 4- 1 f 1 

f( x ) = ^2 c k p k{x), C k =—-— / P k (x)f(x)dx. (3.7.13) 

k =0 

Then for the oscillatory integrands we have the formula 

j\ e itx p k( x )dx = i k ^ J k+1/2 (t), (3.7.14) 

and the integral for c^ in (3.7.13) is found by using a (n + l)-point Gauss-Legendre 
rule which is exact if / is a polynomial of degree < n. Bakhvalov and Vasileva 
(1968) also give the recurrence relation 



Alternatively, if f(x) is expanded in terms of Chebyshev polynomials T n (x) by 


f(x) = Y / 'a k T k (x), (3.7.15) 

k =0 
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where a/,. = 


2 f 1 T k {x)f{x) 


get the formula 


/: 


-1 \/l — ; 


dx is computed by a Gauss-Chebyshev rule, then we 


where 


/ i r n 

f(x) < (tx)dx = (3.7.16) 

-i l sin ^ 

N k (t) = J T k {x) e itx dx. 

Formula (3.7.16) can be regarded as a Lagrangian interpolation polynomial of degree 
n which collates with f(x) at the (n A 1) points Xj , j = 0,1,... , n. If these points are 

(2 j + lW 

taken as the zeros of T^+i (x), i.e., Xj = cos — -—, then using the orthogonality 

2(n A 1) 

property of the Chebyshev polynomials, we find that 


a 7 = 


n A 1 




cos 


3 =0 


(2 j + 1)7T 
2(n + 1) 


An alternative formula to compute is 


a* = 


1 Ti{x)f{x) 


r 

7-i v 


7T 7-1 \/l - T 2 


dx. 


(3.7.17) 


(3.7.18) 


If / G P n , then the integral in (3.7.18) is obtained exactly by using the Gauss- 
Chebyshev equal weight quadrature rule of order (n A 1) with the weight function 

(x) = (l — x 2 ) on the interval [—1,1]; i.e., we use the general formula 


w 


L 


F{x) 

-1 y/1 — X 2 


dx = ^Xi H F 6 ; i) + e ”+ 1 ’ 


3=0 


where Xj are given by (3.2.11) and the error term by 


2n F 2n+2 (0) 


- 1 < 0 < 1 . 


22n+2 (2 n _|_ 2 )! ’ 

Piessens and Poleunis (1971) use the expansion of e ltx in the form 


(3.7.19) 


(3.7.20) 


e itx = 2 ^2'i j Jj(t) Tj(x), 

3=0 


(3.7.21) 


and obtain the formula 


i n i n = -2 

3=0 


L(n A j) 2 — 1 (n — j) 2 — 1J 


(3.7.22) 
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which depends on t, and thus we have an increased amount of computation as t 
increases. 

Patterson (1976) evaluated the integral Nk(t) in (3.7.16) by expanding T^{x) as 
a series of Legendre functions and obtained the formula 


f 1 f(x) e itx dx^Jf fl'aj E ^ ( 2/c + *) J fc+i/2(*), (3-7.23) 

’d —1 V •—n u —n 


j =0 k =0 


where the recurrence relation to compute Rj~j is given by 


Rk,j — 


J Pk{x)Tj(x) 


7 '2 I p \ 

dx, Rk+2,j = ( p _ ^ J Ri,j • (3.7.24) 


This method provides a stable approximation except that we need an efficient proce¬ 
dure to evaluate Bessel functions. 

According to Alaylioglu, Evans and Hyslop (1976), to compute the integral I cos = 
f(x) cos ( tx) dx, we use a linear transformation of the form x = ^ ^ —°^L 

which results in 


/cos " 


b — ( 


L\ 


(b + a)w 


(b + a)i 




cos -— — —F(£) cos (w£) — sin -— -F(£) sin(rc<f)J 

(3.7.25) 

n 

where w = (b — a)t/ 2. If we approximate F(£) by F(£) « a* T^(£), and collate 


i=0 


7TJ . 


at the n + 1 nodes = cos —, j = 0,1,... , n, then we obtain 


b — a r (6 + a)rc 


cos 


71 ,, f 1 

E"- 0 *.™ / U cos {w£)d£, 

i =0 


— sm 


(b + a)rc 


n f 1 

E''U™ / C m sin«)^], (3.7.26) 

i=0 


where the coefficients are defined by the recurrence relation (1.2.11) for T n (x), 
and 


2 n 

ai = - E UG cos 

n j=o 


TTji 

n 
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Similarly, 


Is in = / f(x) sin (tx) dx 

J a 

b-a r . ( b + a)w ■A" „ f 1 . TO , .. 

Y A,m / cos«) d£ 

i=0 


sm ■ 


— cos 


(b + a)w D . m f s i n ( w £)d£, (3.7.27) 

7=0 


where for the integrals we use the formula 


/‘ r( cos (»«)<« = ± t «f m ) A? { si " (»«+W2) 

7_i l sm V n / ^ + l cos 


(3.7.28) 


-l 


The series in (3.7.28) converges rapidly for large w provided f (pc) is smooth and has 
a fit by a Chebyshev series with small n. However, for small w and large n we may 
find instabilities. An alternative method to avoid this situation is to use the following 
series expansions: 



cos (tx) dx 


sin (tx) dx 


k =0 
oo 


(-1 n 


k+2k 


(2k + m + 1) (2k)\ 

(-1 ) H 2k+1 

(2 k + m + 2) (2k + 1)! 


m even, 


m odd. 


(3.7.29) 


The maximum value fco of k that gives precision accuracy up to 22 figures for these 
intervals is given roughly by ko = 2w + 10 (round-off to integer values), which for 
the truncation of the infinite series is reliable for w < 10. But for large values of 
w the situation is fluid; for example, fco ~ 210 for w = 100, although the actual 
maximum value of k turns out to be about 160. Thus, for such large values of w it is 
better to use formulas (3.7.28) instead of (3.7.29). 

Example 3.7.2. Compute 


p2tt 

Jo ; 


x cos x sin (to) dx = < 


-for t = 1, 

2 


2irt 

l *231 


for t = 2, 3,. 


The results are compared in Table 3.7.2, which are obtained by Piessens and Poleunis 
formula (3.7.23) and by Alaylioglu, Evans and Hyslop formula (3.7.27). In the former 
case the number of function evaluations is 30, compared to 19 or 20 in the latter case 
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which also gives better results. ■ 


Table 3.7.2. 


t 

Exact 

Formula (3.7.23) 
Absolute Error 

Formula (3.7.27) 
Absolute Error 

1 

-1.5707963267948966 

5(—15) 

4(—16) 

2 

-4.1887902047863910 

9(—15) 

6(—16) 

4 

-1.6755160819145564 

3(—15) 

1(—15) 

16 

-0.3942390780975427 

1 (— 14 ) 

5(—15) 

64 

-0.0981987447275930 

3(—15) 

2(-16) 

256 

-0.0245440671189132 

1(—15) 

2(-16) 


Example 3.7.3. Compute cos (tt px 2 ) cos(irqx) dx , which has the exact 
value 

{ cos A[C ( B 1 ) + C (B 2 )} + sin A[S (B,) + S (B 2 )]}, 

where A = = \ ~ (p±-\ and C(z) and S(z) are the Fresnel integrals 

4p ’ V P ' 2/ 

(Bakhvalov and Vasileva 1968). The results for the exact values and absolute errors 
for different values of n are presented in Table 3.7.3. 


Table 3.7.3. 


P 

7 

Exact 

n = 9 

n = 15 

II 

to 

to 

1 

4 

5 

4 

-0.025816237030406 

2.3(—8) 

1.5(—13) 

* 

1 

4 

41 

4 

0.02966470953267 

1.7(—7) 

5.7(—12) 

* 

1 

4 

451 

4 

0.00283575769375 

1.1(—9) 

8.9(—14) 

* 




3 

II 

OO 

n = 40 

n = 47 

23 

4 

5 

4 

0.38215576878521 

1.7(—8) 

4.5(—12) 

9.1(—13) 

23 

4 

41 

4 

0.09736922562982 

1.6(—5) 

2.0(—8) 

6.0(—12) 

23 

4 

451 

4 

0.00256072719178 

8.4(—8) 

1.6(—10) 

2.9(—12) 

47 

4 

5 

4 

0.24111868127101 

4.3(—5) 

8.0(—6) 

1.0(-7) 

47 

4 

41 

4 

0.26746038313517 

2.5(—2) 

6.2(—4) 

1.4(—8) 

47 

4 

451 

4 

0.00233286903629 

2.8(—4) 

1.4(—4) 

1.6(—5) 


* exact in more than 22 digits. 
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3.7.3. Nontrigonometric Oscillatory Functions. Ehrenmark’s formula 
(1968) 



dx — Aq f (0) + 2Ai f (h) + A 2 f (2 h) + E, 


(3.7.30) 


which is of the Newton-Cotes type, is exact for f(x) = 1, sin(fcr), and cos (tx), and 


for these functions A 0 = A 2 = 


th — sin (th) 
t[ 1 — cos (th)] 


, and A\ = h — A 0 . This formula can 


be used to compute integrals of the form J ^ cos(p cos x — q sin x) dx, where p and 
q are constants. Its accuracy becomes more accurate with the increase in the number 
of subdivisions of the interval of integration, i.e., with the decrease in the step size 
h. There are three extensions to higher point numbers N, with the choice of f(x) 
which, when used, makes the formula exact. These are the following sets {Cj 60): 

(i) sin(ta), cos (tx), 1 , x, x 2 ,... , 

(ii) 1, sin(fcr), cos (tx), sin(2Ar), cos(2Ar), sin(3Ar), ..., and 

(iii) 1, sin {tx)/M, cos (tx)/M, sin(2 tx)/M, cos(2 tx)/M, sin(3 tx)/M, ..., 


where M = [n/ 2]. There are two choices for the nodes, one equally spaced to yield 
N-C type formulas and the other cosine-weighted nodes as in the Clenshaw-Curtis 
formulas. Most of these extensions are for the set (ii) where no particular choice is 
made for the nodes. Once these nodes are fixed, the weights Wi are determined by 
solving the system of linear algebraic equations 



n 

^ Wi Cj (xi) , j = 1 ,... ,n. 


(3.7.31) 


For integrands of the form sin k(at + (3) a suitable transformation to change each 
subinterval to [0,2 h\ is required. 

Levin’s method (1982) to compute the oscillatory integrals of the form I = 
J a 6 f(x) e iq ^ dx is based on assuming that f(x) is of the form f(x) = iq r {pc) p(x) + 
p'(x), which is a linear ordinary differential equation and has the solution 


p(x) = e 


iq(x) 



eiiW dt + c 


Then the integral I is evaluated directly to yield 


I = p (b) e iq{b) - p(a) e iq(a) 


(3.7.32) 


This means that the solution (3.7.32) is as oscillatory as the original integrand in I . 
But if both / and q are slowly oscillatory, then a slowly oscillatory solution po(x) is 
obtained by substituting p(x) = po(x) + ce~ iq ^ into (3.7.32); this solution is 

I = p 0 (b) e iq{b) - po{a) e lq(a l (3.7.33) 
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To compute po(a) andpo(fr)? we take an n-point collocation to the basis set {uk(x)} 

n 

for k = 1,... , n, so that when po(x) = Uk(x) is substituted into f(x) = 

k =l 

iq'(x)p(x) + we obtain a system of n algebraic equations to evaluate a^. 

Then I is computed from (3.7.33). 

Evans (1992) has considered integrals of the form J ^ f(x) J n (tx) dx, which are 
reduced to the form 



y J Jn(Ay + B) dy 


1 

AJ + 1 


L 


B-\-A 


(z - B) J J n (z) dz , 


B — A 


(3.7.34) 


where A = (b — a)/2, B = (6 + a)/2, and z = Ay + B. These integrals are then 
evaluated by using the formula 


/ v + y + 

V 2 

^ - /i + 1 

2 

(i/ + 2fc + i)r U~^ + 1 +fc) 

X ^ ^T + TI+3 ^ Ju+ 2 k+l(z). 

k=o r ( - +/cj 



(3.7.35) 


While computing, one must be careful when combining the functions T ^ 
'v — y + 1 


^ - /i + 1 


and T 


k ) since both become zero when their arguments are negative 


integers although their quotient is not singular. The expansion (3.7.35) becomes 
numerically unstable if B A. 


3.8. Noninterpolatory Product Integration 

In connection with the product integration on the finite interval [a, b], consider a 
class of n-point quadrature rule Q n (f ) of degree at least 2 n — 3. It is known that 
such a quadrature rule is uniquely determined by one node x' and the corresponding 
weight w'. For a given node x' let us characterize all weights w for which the pair 
(x f , w') generates a positive quadrature formula. Also, for each fixed node x' which 
is not a node of the Gaussian rule Q^_i and for each negative weight w\ there exists 
a quadrature rule Q n of degree 2n — 3. If all nodes are contained in the interval 
[a, 6], then each such quadrature rule converges for all / E C 1 [a, b\. Thus, given 
a nonnegative weight function on [—1,1], a quadrature rule Q n E V m is a linear 
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functional map of the type 


n 

Qn(f) = ^ ^ ^kn f (%kn) i W kn € R-, OO < X\ n ^ %2n • • 

k=% 

• ^ %nn ^ OO, 

(3.8.1) 

j w(x) f(x)dx = Qn(f) + E n (f), 

(3.8.2) 

/ /x f = 0 for l = 1,... , m. 

En (x l ) < 

' ' \ 0 for l = m + 1, 

(3.8.3) 


where x l denotes a monomial, and E n is the error functional of Q n (/). Let {Q n } 
define a sequence of quadrature formulas Q n , n = 1,2,.... Then Q n is said to be 
a positive quadrature rule iff all weights w^ n > 0. Let Q^ denote a Gaussian rule 
using n nodes, with maximum degree 2n — 1, and letp n ( x) be orthogonal polynomials 
associated with Q^ and defined by 


Pn(%) — (■ 


X — X 


kn 


)> 


k =1 


I'm 


x)Pm(x) w(x) dx = S n 


where a n > 0. According to Freud (1969) all quadrature rules Q n of degree > 2n — 2 
are positive, while a quadrature rule of degree 2n — 3 may have at most one negative 
weight (Micchelli and Rivlin 1973). Forster (1992) has studied the convergence of 
the sequences {Q n } of degree > 2n — 3, and proved that for a function / E C[— 1,1] 
and for every node x’ G R\{xi, n -ii x 2,n-ii • • • > x n-i,n-i} an d ever Y w > 0, (i) 
there exists a unique rule Q n of degree > 2n — 3 which has a node at x f and the 
associated weight w’\ (ii) all nodes of Q n are contained in the interval [a, /?], where 
a = mm{y^xf n _ 1 } and (3 = max{?/, n-1 }; (iii) liminf \E n (f)\ > 0 for 

’ ’ n—^oo 

a function / G C 1 [—1,1]; (iv) if the each rule in the sequence { Q has degree 
> 2n — 3 and all nodes Xkn are contained in [—1,1], then lim E n (f) = 0 for 

n—> oo 

every function / which has absolutely continuous derivative f on [—1,1]; and (v) 
if Ck (Q n ) = sup \E n (f)\ denotes the error constant of order k for ||/^|| = 
ll/ (fe) ll<i 

sup \f^ |, then for all nonpositive rules Q n of degree > 2n — 3, the error E n (f ) is 
l x l <i 

positive of degree > 2n — 2, and 


Gi—2 (Qn) ^ C2n —2 (Qn—l) ? 


C2n-2 (Qn) 1 

lllll - = 1. 

n ^°° Gin-2 (Qn—1) 


Note that for the N-C rules Q^ c there exist analytic functions / on [— 1,1] for which 
the sequence {Q^ c } diverges (see Brass 1977). 

Product integration provides an important aspect that is useful not only in quad¬ 
rature rules but also in computation of integral equations (sse §10.4). For a linear 
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interpolatory quadrature rule with positive weights, let S denote the set of nodes. 
According to Patterson (1969) there exists a set T c S which contains (n — 1) 
nodes such that the weights of the rule on T are all nonnegative. Thus, for any lin¬ 
ear positive interpolatory (product) integration rule (PIIR) Q it is always possible to 
generate a sequence of imbedded PIIR’s which start with Q. Let the integral I%(kf), 
where — oo < a < b < oo, be approximated by the PIIR’s of the form Q n (f) = 

n 

X] w in f (Ti n ). These rules are exact for / £ V n -\> Then, given two distinct HR’s 

Q n (f ) and Qm(f )> with their respective nodes X n = {xi n : i = 1, 2,... , n}, and 
X m = {xi m : m = 0,1, 2,... , m}, the rule Q m (f) is said to be totally imbedded 
in Qn(f) if X m C X n , and partially imbedded if m < n and X m n X n = 0. 
Rabinowitz et al. (1987) have proved that for any PIIR Q n (f) with the set of nodes 
X n , there exists a finite set of PIIR’s {Q Uk (/); k = 1, 2,... , m < n} such that (i) 
Qm (/) = Qnif ), (ii) Qn k+ 1 (/) is imbedded in Q Uk (/), and this finite set of PIIR’s 
is exact for / £ V nk - 2 , k = 1,2,... , m — 1. Also, if [a, 6] is a finite interval or 
(—oo, oo), let c = (6 + a)/2 or 0, respectively. Then the rule Q n (f) is said to be 
symmetric if Xi n -\- c = c — x n +i-i, n andiG n = w n+i-i,n fori = 1, 2,... , n. Note 
that in such a symmetric case the PIIR rule Q n (/) is of precision n if n is odd. Also, 
there exists a finite sequence of imbedded symmetric PIIR’s with the rule Q n (f) a s 
the first element of this sequence, and each rule is of precision < r — 3, where r is 
the number of nodes in the previous rule in the sequence. 

For a linear interpolatory quadrature rule with positive weights, let S denote the 
set of nodes. According to Patterson (1969) there exists a set T c S which contains 
(n — 1) nodes such that the weights of the rule on T are all nonnegative. Thus, for any 
linear positive interpolatory (product) integration rule (PIIR) Q it is always possible to 
generate a sequence of imbedded PIIR’s which start with Q. Let the integral I%(kf), 
where — oo < a < b < oo, be approximated by the PIIR’s of the form Q n (f) = 

n 

XI w in f (Ti n ). These rules are exact for / £ V n -\> Then, given two distinct HR’s 

Q n (f ) an d Qm(f )> with their respective nodes X n = {xi n : i = 1, 2,... , n}, and 
X m = {Ti m : m = 0,1, 2,... , m}, the rule Q m (f) is sa id to be totally imbedded 
in Qn(f) if X m C X n , and partially imbebded if m < n and X m fl X n = 0. 
Rabinowitz et al. (1987) have proved that for any PIIR Q n (f) with the set of nodes 
X n , there exists a finite set of PIIR’s {Q Uk (/); k = 1, 2,... , m < n} such that (i) 
Qm (/) = Qnif )> (ii) Qn k+ 1 (/) is imbedded in Q Uk (/), and this finite set of PIIR’s 
is exact for / £ V nk - 2 , k = 1,2,... , m — 1. Also, if [a, 6] is a finite interval or 
(—oo, oo), let c = (6 + a)/2 or 0, respectively. Then the rule Q n (f) is said to be 
symmetric if Xi n -\- c = c — x n +i-i, n andrG n = w n+i-i,n fori = 1, 2,... , n. Note 
that in such a symmetric case the PIIR rule Q n (/) is of precision n if n is odd. Also, 
there exists a finite sequence of imbedded symmetric PIIR’s with the rule Q n (f ) as 
the first element of this sequence, and each rule is of precision < r — 3, where r is 
the number of nodes in the previous rule in the sequence. 

The technique of product integration discussed here deals with the noninterpo- 
latory (nonpolynomial) integration rules which are based on generalized piecewise 
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polynomial interpolation and modified moments. Product integration rules have been 
studied by Atkinson (1976), Dagnino (1983), de Hoog and Weiss (1973), Elliott and 
Paget (1976, 1978), Rabinowitz (1986, 1987), Lubinsky and Sidi (1986), Schneider 
(1981), Rabinowitz and Sloan (1984), Sloan (1980), Sloan and Smith (1978, 1980, 
1982), Spence (1979), and Topler and Volk (1980). Besides its use in integration of 
functions which are products of two functions, it has been applied in numerical solu¬ 
tion of Fredholm integral equations of the second kind (see Chapter 9). We consider 
two functions k E Li(a, b) and / E F[a, b] and define the approximation 

m n 

I b a {kf ) ss /„(/) = ^2,w in f Xrn , (3.8.4) 

i=1 

such that I n (f ) —> Ia( w f ) = J^ w(x) f(x) dx as n —> oo for all / G F[a,b\ , where 
w G A[a,b]; here Xi n are the zeros of q n + a +p(x) = (1 — x) a (l + x)^p n (x^w), 
a, [3 G (0,1), where p n (x,w) are orthonormal polynomials with respect to some 
w G A [a, b}\ and the moments f^ w(x) x l dx < oo for i = 0,1,... (for more on 
moments, see §4.4). We define the integration rules {Q n (f)} by 

m n 

Qn(f) P V W in {x) f ( X in ) , (3.8.5) 

i=l 


and determine the conditions on k, /, and the sequence {I n (/)}, which guarantee that 
Qn(f) —> Ia(kf) asn — >• oo. The weights Wi n are chosen such that (3.8.5) is exact 
for all / G P n+Q+i g_i. Sloan and Smith (1978, 1980, 1982) and Rabinowitz (1986) 
have shown that the sequence {Q n (f)} converges to Ia(kf) for all / E F[a, b] or 

m n 

f e C[a, b], and that \Q n \(f) = J2 K«DI / ( x in) converges to 1% (|fc| /). 

i=1 


Let 


M ,(k) = / *(*)i(*)Si(s»)*, 


(3.8.6) 


denote the modified moments of k with respect to a given sequence of polynomials 
Pj(x m ,w), where K(x) = k(x)/w(x). We will define the generalized piecewise 
polynomial product rule (abbreviated GP 3 IR) as follows: Let the partition of the 
interval [a, b] be — oo < a = to < t\ < ... < t n = b < oo; let hi = ti — U-t for 
i = 1, ... ,n, and let A n = max/u* Similarly, we partition a subinterval \ti-i,ti\ 
by ti- 1 = x i0 < xn < ... < x ii7n% < x iirn% + i = U, for mi > 1. The points x ij9 
j = 1,... , mi, are called the grid points (abscissae or nodes). Two grid points are 
coincident if Xi jrrii> = ti = Xi+ i, m ,. Define j = 0,1,... , ra$. 

Note that /uo = 0 if = ti- 1 , and /u,™ 4 = 0 if = ti. Then the product 
integration rule is 


n m z 

Qn(f) = w ij fij 5 fij = f ( x ij) 5 

i=l J=1 


(3.8.7) 
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Wij = / lij k{pc) dx, i = 1,... , n; j = 1,... , m i? 
Jt % -1 


m % 

= n 


=i 


%ik 


(3.8.8) 

(3.8.9) 


where are the fundamental Lagrange polynomials. Alternatively, Rabinowitz 
(1987) defines this product integration rule by 


Qn(f) = 


n rt % 

£/ 

i=1 Jt % -l 


fc(x) Li(x) dx , 


(3.8.10) 


m x 

where (x) = ^ (x) . It is shown that if 

i=i 


r Li(x) if ti_i <x <ti, 

Pn(x) = r n 

[ Li(a) it x = cl, 

then Qn(f) = Ia(kPn), where p n is a piecewise polynomial in the class VM n -u 
and M n = max Moreover, if ^ = t 2 = x i+ i^ for 1 < i < n — 1, then 

l<i<n 

p n G (7[a, 6]. However, it is noted that in the case of a general distribution of the 
nodes , a rule Q n (/) may fail to converge to (fc/), even if / G C [a, 6] and k = 1, 
A n —> 0 and M n is bounded. The reason for such a case is that the polynomials 
Uj (x) may not be uniformly bounded for large n in an interval [U-i , ti \. But if 

\lij(x)\<L, xE[ti-i,ti\ for al li,j,n, (3.8.11) 

then we have (i) hij > chi for a constant c G (0,1) for all i = 1,... ,n and 
j = 1,... , rrii, and (ii) M n < M for all n. Then 


MA = 


n 

k =1 
Ml 


X Xik 
%ij %ik 


< 



1 

< -=- 

C M ~ 1 


= L, 


Then, in view of the condition (3.8.11), we have 


ti -1 < x <ti. 

(3.8.12) 



hj(x) k(x) dx 



(3.8.13) 


A sequence of rules (3.8.7) is called a sequence of GP 3 IR if (i) > chi for 

c G (0,1), i = 1,... , n and j = 1,... , rrii, (ii) A n —> 0 as n —> oo, and (iii) 
M n < M for all n. For such a sequence, Q n (f ) —► la(kf) f° r all / E C[a, 6] 
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and for all / G P[a, b] (Rabinowitz and Sloan 1984), and Q n (f ) —> Ia(kf) for all 
/ G R[a,b\ (Rabinowitz 1987). 

3.8.1. Approximation by Fourier Series. A sequence of integration 
rules {I n (f)} associated with the weight function w(x) G A[a, b] such that I n (f) —> 
Ia(wf) for all / G F[a, b] is obtained by approximating / by a finite part of its 
Fourier series expansion in the orthonormal polynomials p n (x; w): 

N 

f( x ) ~^2 a jPj( x ', w ), (3.8.14) 

j =o 

where ctj = (f,Pj). If we replace ctj by 

m n 

&jn = In (/ Pj) = ^ ^ Win f {%in) Pj (%in;w) ? (3.8.15) 

then 

N 

I b a(kf) « = Qn(f), (3-8.16) 

j=0 

where Mj(k) are given by (3.8.6). If we use orthogonal polynomials instead of or¬ 
thonormal polynomials, we must divide ctj by (jpj , pj ) and dj n by hj . The recurrence 
relations for Mj(k) for different types of functions K(pc) = k(x)/w(x) on [—1,1], 

with w(x) = (l — x 2 ) and pj(x ; w) = T n (pc) are given in Piessens and Bran- 
ders (1973, 1975, 1976, 1983). Modified moments Mj(k) (see §4.4.10) are exactly 
the Fourier coefficients of K(x) . In particular, the modified moments with w(x) = 1 
and Pj(x) = Pj(x) (Legendre polynomials) on [—1,1] coincide with the Fourier 
coefficients; for w(x) = (1 — x) a (l + x)& (Jacobi weight function), Paget (1976) 
gives formulas for the Fourier coefficients of (i) K(x; A) = e lXx , where A is real; 
(ii) K{x\ A) = log|x — A|, —1 < A < 1; and (iii) K(x, A) = \x — A| s , s > —1, 
— 1 < A < 1; and also an algorithm to compute the sum J2 c jMj(wk). Additional 
modified moments with Jacobi and Legendre polynomials are available in Gatteschi 
(1980). In all cases, Q^ (/) is exact for all / E V n ~\. 

Let L 2 , w denote the weighted L 2 normed space defined by L 2 , w = {g : 11 g 11 2 , w < 
oo}, and F denote a family of functions defined on the finite or infinite interval [a, b] 
such that / G F[a, b] is either / G (7[a, b\ or / G R[a , b\. Suppose that w G A[a, b\, 
K e L 2 , w [a,b], and / G L 2 , w [a,b\ n F[a,b\. If I n ( fpj ) -> (f,Pj) for all j and for 
all / G F[a, b], then 

lim lim Q *(/) = Ia(kf). (3.8.17) 

N^-oo n ^oo 

This result is proved in Rabinowitz (1987), where two other results on double limits 
are also given. The first one concerns the generalized smooth Jacobi weight function 
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on [—1,1], which is defined by w(x) = t/j(x)(l — x) a (l + x)@ |tk — x \ lk , 

k=1 

where —1 < t\ < ... < t m < 1; a,/3,jk > — 1 for k = 1,... , m; and ^ > 
0 such that f* t) t~ x dt < oo. For this w(x), let v(x) = (1 — x) A (l + 

m 

x) B n \tk — x\ Ck , where A = — max{(2a + l)/4,0}, B = — max{(2/? + l)/4,0}, 
k =1 

C = — max{7/ c /2,0} for A: = 1,... , m. Let kv G L p [a, 6] for some p E (1, oo), 
and let //t g L g [a, 6], where p _1 +g _1 = 1. Then (3.8.17) holds if / E F[a, 6], and 
In ( fPj ) —^ (f,Pj) f° r all 7 and all / £ E [a, b\ . The other result concerns the partial 

N 

sum SnK(x) = XI a j K( x ) which converges to K(x) in [a, 6]. The (3.8.17) holds 

.7=0 

m n 

if I n (gp ) —► Ia( w 9P ) f° r all 9 £ E[a, 6] and all polynomials p, if \w in \ < B for 

i=l 

all n, and if / G F[a, 6] is bounded and sup |/| = Mf. 

3.8.2. Asymptotic Error Estimates. We will derive some error estimates 
for the Gaussian rule 


l\ 1 {wf) = ^2,w k f (x k )+E n (f), (3.8.18) 

k =1 


where the nodes Xk are the zeros of a polynomial p n (x) of degree n with the leading 

f 1 / X Pn(x) 

J w(x) 


coefficient k n , the weights Wk are given by Wk = 


(x - x n ) p' n (x) 


dx, and 


the error by E n (f ) 


define q n (z) = 


/: 


f 2n (0 

= -— , » , (see Davis and Rabinowitz 1984, p. 305). If we 

(2 n)\kl 

w(x) dx, z & [—1,1], then 

z — x 


E n (f) 


1 f gn(z) 
2«7T J r p n (z) 


f(z) dz, 


where T is a closed contour in C containing [—1,1], f(z ) is analytic in C, and w and 
| log w \ belong to the class R[— 1,1]. By using the mapping z = I (£ + _1 ), which 
maps the circle \z\ = p > 1 in the £■-plane onto the ellipse in the z-plane with 
foci at ±1 and the semi-axes \ (p + p _1 ), and for the inverse mapping choosing the 
sign of the square root such that |£| > 1 for z ^ [—1,1], we find that on any compact 
support of C\[— 1,1] 


Qn(z) 

Pn(z) 


2tt £ 2n 1 D (£ w) (1 + o(l)) as n —> oo, 


(3.8.19) 
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where |£| > 1, and 

f I r 71 i _i_ £—i 1 

D(C U ,w) = ex p|—y log [w(cos6>)] e _. e d8j (3.8.20) 

= £ _fc exp{ — [ log [tn(cos0)]l exp {— Ylog [tn(cos0)] cosk6d6\. 

ln Jo J U k=i (3.0.21) 


Some properties of D (£ 1 ;w) are: 

(1) d (r 1 ;w 1 w 2 ) = d (r 1 ; w 1 ) d (r x ; ™ 2 ); 

(h) d (r 1 ;w 1 /w 2 ) = d (r 1 ;^) /d (r 1 ;^), 

(iii) D (<f _1 ; w p ) = D (£ _1 ; w) p for constant p, 

(iv) D (<f _1 ; k) = k for scalar fc, and 

(v) D fc^i) = k D (<f _1 ; wi) for scalar k. Also, 

P7T 

/ log [w(cos0)] cosk0de = --T t ^ k r j , (3.8.22) 

Jo k J 


for k = 1, 2,..., = aj + 

Thus, Chen (1982) proves that 


a 2 

j 


1, 1^1 > 1, and = Res^ =aj 


. w(z) - 


£ (rlO = e Ao n (i -c/r 1 )"" for Ki >!. ( 3 - 8 - 23 ) 

3 


where A( 


=~ f 

* J-l 


log [w(z)\ 

-1 \A — T 2 


dx. Some special cases are: 


1. If w(x) = (1 + x) m (l — x) n wi(x) for some nonnegative constants m, n, and 
wi(±l) ^ 0, then 

d (r 1 ; w) = 2 ~ m ~ n (i+r 1 ) 2 ” 1 (i - r 1 ) 2 ” d (r 1 ; ^i) • 

Thus, D (C _1 ;«') for the Gauss-Jacobi rule is obtained by setting m = a and f3 = n. 

2. If w(x) = 1/ ( x 2 + a 2 ) for a > 0, then 


D{C u ,w) = 


\ + \f (i~ + 1 


1 + 


(Vet 2 + 1 — a) i 2 


(3.8.24) 


C 2 


3. If w(x) = l/(x + a) for real |a| > 1, then 
c-i. ^ 2 


Die 1 ;™) = 


(n T \/ (i~ T 1 ) 


1 + 


— \/a 2 + 1 ] 2 

£ 


(3.8.25) 
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Finally, in view of (3.8.19) we find that 

E n {f)~i j T eh(z) DiC 1 \w) dz. 

We consider the following cases. 

Case 1. if / is an entire function, then from (3.8.26) we get 

a 


E n (f) ~ -iVzir 


y/\h" ( z o) 


:e h(zo )d(£~ 1 ;w) 


IOL 


V2tt a/| h" (z 0 ) 


a h(zo)+A 0 


(3.8.26) 


no-uUo-T’ 


(3.8.27) 


where h(z) = \og[f(z)} — (2n +1) log [z + z 1 — 1 ]; zo ^ [—1,1] is a simple zero 
of h'(z ); £ 0 = + (z§ - l); \a\ = 1 and arg{a} = \ [tt - arg{/i // (z 0 )}]; and 

ay are simple poles of w'/w. There are two saddle points at =by/(2 n + l) 2 + 1, of 
which the negative saddle point can be neglected because its contribution is relatively 
small. 

Example 3.8.1. Let w(x) = e x , f(x) = 1/ (x 2 + a 2 ), and a = 0.01. Using 
the Gaussian rule (3.8.18), we find from (3.8.24) and (3.8.27) that 


En{f) 


(cl y/ cl 2 + 1 ) 


I— e z ° 4“ 271-1 
^0 


1 + ^\/1 + cl 2 — a'j 4 


-2 

0 


1 -2 


The values of | E n (/) |, both exact and computed from the above formula, are presented 
in Table 3.8.1. ■ 


Table 3.8.1. Values of \E n (f)\. Table 3.8.2. 


n 

Exact 

Approx. 

Exact 

Approx. 

3 

0.2474(—3) 

0.2762(—3) 

0.6887(—1) 

0.7446(—1) 

4 

0.1132(-5) 

0.1227(-5) 

0.1219(—1) 

0.1278(—1) 

5 

0.3186(—8) 

0.3396(—8) 

0.2109(—2) 

0.2193(—2) 

6 

0.6091(—11) 

0.6413(—11) 

0.3644(—3) 

0.3762(—3) 


Case 2. If f(z) has simple poles at ay, j = 1,2,..., then by (3.8.22) 

E n (f) « -27^2? (r» ij 2n r j- (3.8.28) 

3 

Example 3.8.2. Let f(x) = 1/ (x 2 + l), w(z) = 1/ (x 2 + a 2 ), and a = 0.1. 
The integrand (w/) has two simple poles at =b i. Then from (3.8.24) and (3.8.28) we 
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get 


E n {f) « ("I) 


n+1 87 r (l + \/2) ^ 1 - (Vl + « 2 - «) 2 


-2 


(a + \/tt 2 + 1 ) ^ 3 + 2\/2 

The results for |E n (/) | are presented in Table 3.8.2. ■ 

Case 3. If f(z) has an algebraic singularity on the real axis, e.g., f(z) = 
(c — z)^ g(z), c> 1, g an entire function, and fi a rational nonintegral constant, then 


E]y(f) ~ —2sin(/i7r) lim 


/ 

5 J c 


a \c — x\^ g{x) D (£ 1 ;r^) 

C (x + \/t 2 — 1 ) 


2n+l 




= —2 sin(/i7r) (c 2 — l) 


2 A ()i+l )/2 j(c)r(/J+l)D({ V) 


(2n + l)' i+1 £ 


2n+l 


(3.8.29) 


where £ c = c + \/c 2 + 1, |£ c | > 1. 

e 3.8.3. 
l is 

r 1 


Example 3.8.3. Let w(x) = l/(x + a), f(x) = y/2 — x , and a = 1.01. The 
exact solution is 


/ 


t + a 


dx = 2(1 — \/3) — b log 


(V3 -&)(! + b) 

(V3 + b)(l-b) 


where b = y/2 + a. Then from (3.8.25) and (3.8.29) we get 

EM) - (! + ■, 

a + — 1 v Sc y 

where £ c = 2 + \/3. The result for |E n (/)| are presented in Table 3.8.3. ■ 
Table 3.8.3. Values of \E n (f)\. Table 3.8.4. 


n 

Exact 

Approx. 

Exact 

Approx. 

3 

0.3517(—4) 

0.2472(—4) 

0.2069(—3) 

0.1762(—3) 

4 

0.1590(—5) 

0.1218(—5) 

0.1111(—4) 

0.9839(-5) 

5 

0.8020(-7) 

0.6470(—7) 

0.6373(—6) 

0.5780(—6) 

6 

0.4327(-8) 

0.3616(—8) 

0.3794(—7) 

0.3511(—7) 


Case 4. If f(z) has a logarithmic singularity on the real axis, e.g., f(z) = 
#(z) log(c — z), c > 1, and g(z) entire, then 


E n 


pa . _. —2n— 1 

i(f) ~ -2tt ^lim^ J g(x) D (£ _1 ; w) (z + vG 2 - 1J 
2tt g(c) \Zc 2 — 1 D (£ _1 ; re) 


(2n + 1) £, 


2n+l 


dx 

(3.8.30) 


2005 by Chapman & Hall/CRC Press 




























180 


3. GAUSSIAN QUADRATURE 


where £ c = c + \/c 2 — 1 , and |£ c | > 1 . 

Example 3.8.4. Let w{x) = l/(x + a), f(x) = log (2 — x), and a = 1.01. 
Then from (3.8.25) and (3.8.30) we get 


E n {f) * — 


4tt\/3£, 


— 2n—1 


(2n + 1) {a + \/« 2 — 1 ) 


1 + 


; - V« 2 - 1 


where £ c = 2 + \/3- The results for |E n (/)| are presented in Table 3.8.4. ■ 

Example 3.8.5. Let w(x) = e ~ x<2 , f(x) = e x2 , so that rc'/rc = —2z is entire. 
Then D re) = e - ( 1+ ^ V 2 . So as in Case 1, we have 


En{f) 


27r 


(*o) ^0 


2n+l 


— 2n—1 2 ( 

0 e 


(l+^)/2 5 


, v^2 + 2 Vln 5 + 4n + 2 

where :; 0 = ---, Co 

8(2n + 1) zo [-2 + 2V4n 2 + 4n + 2j 3/2 . 
the error estimate from both of them is 


= Z 0 + \Aq - 1 > and h" (z 0 ) = 2 + 
There are two saddle points at ±zo> and 




.(/)« £ 


27r 


h" (z 0 ) 


£o 


— 2n—1 


D *g-(l+£g)/2 


where the ‘sum’ is taken for both saddle points. The results of the values of \E n (f)\ 
are presented in Table 3.8.5. ■ 

Table 3.8.5. Values of \E n (f)\. 


n 

Exact 

Approx. 

3 

0.6839(—2) 

0.6105(—2) 

4 

0.4471(—3) 

0.4734(—3) 

5 

0.2295(—4) 

0.2779(—4) 


3.9. Test Integrals 

Table 1: Test integrals of Kahaner (1971): 

1. [ e x dx = e- 1 « 1.718281828 
Jo 


2005 by Chapman & Hall/CRC Press 























3.9. TEST INTEGRALS 


181 


Z 1 r o, o < x < 0.3 

2. / < - dx = 0.7 

/oil, 0.3 < x < 1 


7 

3. f x 1//2 dx = 2/3 

Jo 

4. J (|| coshx — cosx) dx = || sinh(l) — 2 sin(l) « 0.479428266 

/ i 

(x 4 + a; 2 + 0.9) _1 dr « 1.582232997 

6. [ A 2 dr = 0.4 

Jo 

7. / x _1//2 dx = 2 

Jo 

f 1 

8. / (1 + x 4 ) -1 dx « 0.866972987 

Jo 

9. / 2/ (2 + sin(107rx)) dx = 2/\/3 « 1.154700538 

Jo 

. / (1 + x) _1 dx = In 2 « 0.6931471806 

Jo 

. [ (1 + e*) -1 dx = 1 + In 2 - In (1 + e) « 0.379885493 

Jo 

/ xj (e x - 1) dx « 0.777504634 

Jo 

[ sin(lOO)/7rx dx = ln(10) sin(lOO )/tt « 0.009098645257 
7o.i 

r 10 2 

14. / \/50 e _507ra:2 dx = 0.5 erf (50\/27r) = 0.5 

l»io 

15. / 25 e -25 * dx = 1 - e -250 « 1 

Jo 

/TO 

16. / 50/ (tt (1 + 2500x 2 )) dx = tan" 1 (500)/7r « 0.49936338107 

Jo 

17. / (sin(507rx)) 2 / (507rx) 2 dx 

do.oi 

= [TrSi(lOOTr) - (7rSi(7r) - 2)] /(50 tt 2 ) « 0.11213930827 

18. / cos (cosx + 3sinx + 2cos(2x) + 3cos(3x) + 3sin(2x)) dx 

Jo 

■f ] 


10 


11 


12 


13 


0.8386763426 


19. / lnxdx = —1 
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.56439645 


/ i 

(x 2 + 1.005) -1 dxttl.l 

21. [ (sech 2 (10(a; — 0.2)) + sech 4 (100(a: — 0.4)) 
Jo 


- sech 8 (1000(a; - 0.6))) dx « 0.2108027355 


Table 2: Test integrals of Cassaletto, Picket and Rice (1969): 

71—1 


We use the notation: F&(x) = XI (—l) J (j + 1 )x k j 1 - 

3=0 


I dx = 1 

= -3/2 = -1.5 

.33333333333333 


1. [ F 1 (x)i 
Jo 

2. / F 2 (x)dx = -3/2 = -U 

Jo 

3. [ F s (x)dx = 7/3 « 2.. 

Jo 

4. / F 4 (x) dx = -35/12 « -2.916666666666666 
Jo 

5. [ F 5 (x)dx = 37/10 = 3.7 
Jo 

6. [ F 6 (x) dx = -259/60 « -4.316666666666666 
Jo 

7. I F 7 (x) dx = 533/105 ~ 5.076190476190476 
Jo 

8. [ F 8 (x) dx = -1599/280 « -5.710714285714285 
Jo 

9. / F 9 (x) dx = 1627/252 « 6.456349206349207 
Jo 

10. / Fio(x) dx = -17897/2520 « -7.101984126984127 
Jo 

[ F n (x) dx = 18107/2310 « 7.838528138528138 
Jo 

. I F 12 (x) dx = -235391/27720 « -8.49173881673882 
Jo 

. [ Fis(x) dx = 237371/25740 « 9.22187257187257 
Jo 

I Fi 4 (x) dx = -237371/24024 « -9.88057775557776 
Jo 


11 


12 


13 
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15. 

16. 

17. 

18. 

19. 

20 . 

21 . 

22 . 

23. 

24. 

25. 

26. 

27. 

28. 

29. 

30. 

31. 

32. 


3.9. TEST INTEGRALS 


F 16 (x) dx = 95549/9009 « 10.6059496059496 


F 16 (x)dx = -1624333/144144 « -11.26882145632146 


F 17 (x)dx = 1632341/136136 « 11.99051683610507 


F 18 (x)dx = -31014479/2450448 « -12.65665666033313 


F 19 (x)dx = 155685007/11639628 « 13.37542806350856 


I F 20 (x) dx = -155685007/11085360 « -14.04419946668399 
o 

( e~ x dx = 1 - 1/e « 0.6321205588285578 
0 

( simTxdx = 2/7r ss 0.6366197723675814 

0 

[ cos xdx = sin(l) « 0.841470984807897 

0 

[ x/ (e x — 1) dx = 7r 2 /6 — 1 + ln(e — 1) — Li 2 (l/e) 

° « 0.7775046341122486 

f 1 

I (1 + T 2 ) -1 dx = 7r/4 « 0.7853981633974463 


2/ (2 + sin(107rx)) dx = 2/V?> « 1.154700538383864 




0.866972987339911 


( (1 + e x ) 1 da; = 1 + In 2 - ln(l + e) « 0.3798854930417225 

0 


x sin(30x) cosxdx = —607t/899 « —0.209672479661623 


x sin(30x) co,s(50t) dx = 3tt/80 « 0.1178097245099276 


I x sin(30x) j\J 1 — x 2 / (47t 2 ) dx = 27 t 3 Ji (607t) 

° « -2.543259618893547 

[ ((23/25) coshx — cosx) dx = 46 sinh(l)/25 — 2sin(l) 
_1 « 0.4794282266888018 
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33 , 


/ i 

(x 4 + x 2 + 0.9) -1 dx =« 1.582232963729353 


/ 1007T 

((IOOtt) 2 - x 2 )~ V * dx = 50tt 2 Hi(IOOtt) 


34 


« 298.4357164943787 
dx = In 2 « 0.693147180559947 


35. [ (1 + a;) -1 
Jo 

36. [ x 1 / 2 dx = 2/3 « 0.666666666667 
Jo 

37. / x 1 / 4 dx = 0.8 

Jo 

38. / x 1/8 dx = 8/9 « 0.88888889 
Jo 

39. [ x 1/6 dx = 6/7^ 0.857142857143454 
Jo 

i -j 

40. J (\x 2 - 0.25|) 1/2 da; = T + I ^2\/3 - In 2 - In (2 + x/l) /2^ 

41. [ x 3/2 dx = 0A 
Jo 

42. f (|a: 2 — 0.25|) 3/2 dx= + f2^ + ln2 + lnf2 + ^) 

Jo 25b 128 V V / 

« 0.1488716206553019 

43. / aT 2 da; = 2/7 « 0.2857142856503935 
Jo 

■I ^ 2 -°- 25 ^ /2dX= ik + Tk4 (38V3-51n2-51n( 2 + 


0.4647425535922633 


44, 


45, 


46. 


47, 


i: 


2048 1024 

« 0.06551476838416691 


x] dx = 4.5 


[ x, 0 < x < 1/3 
x + 1, 1/3 < x < 2/3 dx = 1.5 


[ x + 2, 2/3 < x < 1 

49 < x < 0.5 


f 1 f 0, 0, 

Jo l -1000 


(x 2 — x) , otherwise 


dx « 164.17195 


«/ , i i/,i+2) ’ oix - e - 2 j x 

Jo \ 0, e — 2 < x < 1 

= 1 - In 2 « 0.3068528194400546 
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49. J (10a;—)(10a; - l.l)(10a; - 1.2)(10a; - 1.3) dx 

° = 1627879/1500 « 1085.252666666667 

50. f sin(1007rx) dx = 0 

Jo 


Comparison of Results. 

Legend: 

Sa- Compound Simpson’s Rule with the number of correct digits; 

Sn\ Compound Simpson’s Rule with the number of digits needed for 10 figures 
accuracy; 

La- Compound Gauss-Legendre Rule with the number of correct digits; 

Ln : Compound Gauss-Legendre Rule with the number of digits needed for 10 figures 
accuracy; 

Pa : Patterson’s Rule with the number of correct digits; 

Pn : Patterson’s Rule with the number of digits needed for 10 figures accuracy; 

C a: Clenshaw-Curtis Rule with the number of correct digits; 

Cjy: Clenshaw-Curtis Rule with the number of digits needed for 10 figures accuracy, 
x : Failed to reach 10-digit accuracy. 

— : Failed to run at all. 

Table 3.9.1. Kahaner (1971) Test Integrals Set. 


Integral 

Sa 

Sn 

L a 

Ln 

Pa 

Pn 

C A 

Cn 

1 

8 

65 

14 

4 

14 

7 

14 

9 

2 

1 

X 

1 

X 

1 

X 

1 

X 

3 

3 

X 

4 

X 

4 

255 

4 

X 

4 

7 

X 

14 

8 

4 

7 

14 

9 

5 

7 

65 

12 

32 

10 

15 

9 

33 

6 

5 

X 

7 

64 

8 

63 

7 

65 

7 

— 


1 

X 

1 

X 

— 


8 

6 

X 

14 

16 

14 

15 

12 

17 

9 

10 

17 

1 

X 

2 

255 

2 

257 

10 

7 

65 

14 

8 

15 

12 

14 

17 

11 

9 

33 

14 

8 

14 

7 

14 

9 

12 

9 

33 

14 

8 

14 

7 

14 

9 

13 

0 

X 

0 

X 

0 

X 

0 

X 

14 

0 

X 

0 

128 

0 

127 

0 

129 

15 

0 

X 

0 

64 

2 

63 

0 

65 

16 

0 

X 

0 

X 

1 

255 

1 

257 

17 

0 

X 

1 

128 

1 

127 

1 

257 

18 

3 

X 

3 

64 

2 

63 

1 

65 

19 


— 

2 

X 

3 

X 



20 

10 

16 

12 

16 

10 

15 

10 

17 

21 

2 

X 

1 

X 

2 

X 

0 

X 
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Table 3.9.2. Cassaletto, Picket and Rice (1969) Test Integrals Set. 


Integral 

S A 

Sn 

L a 

Ln 

Pa 

Pn 

C A 

Cn 

1 

14 

3 

14 

4 

14 

3 

14 

3 

2 

14 

3 

14 

4 

14 

2 

14 

3 

3 

14 

3 

14 

4 

14 

3 

14 

3 

4 

14 

3 

14 

4 

14 

3 

14 

3 

5 

7 

33 

14 

4 

14 

3 

14 

5 

6 

8 

33 

14 

4 

14 

3 

14 

5 

7 

7 

65 

14 

4 

14 

7 

14 

9 

8 

7 

65 

14 

4 

14 

7 

14 

9 

9 

6 

X 

14 

8 

14 

7 

14 

9 

10 

6 

X 

14 

8 

14 

7 

14 

9 

11 

6 

X 

14 

8 

14 

7 

14 

17 

12 

6 

X 

14 

8 

14 

7 

14 

17 

13 

6 

X 

14 

8 

14 

15 

14 

17 

14 

7 

X 

14 

8 

14 

15 

14 

17 

15 

7 

X 

14 

8 

14 

15 

14 

17 

16 

7 

X 

14 

8 

14 

15 

14 

17 

17 

6 

X 

14 

8 

14 

15 

14 

17 

18 

7 

X 

14 

8 

14 

15 

14 

17 

19 

6 

X 

14 

8 

14 

15 

14 

17 

20 

6 

X 

14 

16 

14 

15 

14 

17 

21 

8 

65 

14 

4 

14 

7 

14 

9 

22 

5 

X 

14 

8 

14 

7 

14 

17 

23 

7 

65 

14 

8 

14 

7 

14 

9 

24 

9 

33 

14 

8 

14 

7 

14 

9 

25 

11 

17 

14 

8 

14 

15 

14 

17 

26 

10 

17 

1 

X 

2 

255 

2 

257 

27 

6 

X 

14 

16 

14 

15 

12 

17 

28 

9 

33 

14 

8 

14 

7 

14 

9 

29 

0 

X 

0 

128 

0 

127 

0 

129 

30 

0 

X 

0 

X 

0 

255 

0 

513 

31 

0 

X 

0 

X 

0 

255 

0 

X 

32 

7 

X 

14 

8 

14 

7 

14 

9 

33 

7 

65 

12 

32 

10 

15 

9 

33 

34 

0 

X 

0 

X 

0 

255 

0 

513 

35 

7 

65 

14 

8 

14 

15 

14 

17 

36 

3 

X 

4 

X 

4 

255 

4 

X 

37 

2 

X 

3 

X 

4 

X 

3 

X 

38 

2 

X 

3 

X 

4 

X 

3 

X 

39 

1 

X 

3 

X 

4 

X 

2 

X 

40 

3 

X 

2 

X 

1 

X 

1 

X 

41 

5 

X 

7 

64 

8 

63 

7 

65 

42 

5 

X 

3 

X 

3 

X 

3 

X 

43 

6 

X 

9 

32 

9 

31 

9 

33 

44 

4 

X 

4 

X 

3 

X 

3 

X 

45 

2 

X 

14 

4 

3 

X 

3 

X 

46 

14 

3 

14 

4 

14 

3 

14 

3 

47 

2 

X 

2 

X 

2 

X 

2 

X 

48 

0 

X 

0 

X 

1 

X 

2 

X 

49 

6 

X 

14 

4 

14 

3 

14 

5 

50 

14 

3 

14 

4 

14 

3 

14 

3 
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Improper Integrals 


Improper integrals are such that their range or integrands are unbounded. They are 
defined as the limits of certain proper integrals. Thus, an improper integral over the 
interval [0, oo) is defined as J 0 °° f(x)dx = ^lim f R f(x)dx whenever the limit 


exists. Improper integrals over [a, oo), (— 00 , a] are similarly defined. Improper 
integrals over the interval (— 00 , 00 ) are defined in two ways: First, there is the 
usual definition: J ^ f(x) dx = J ^ f(x) dx + J 0 °° f(x) dx. Then, there is the 
other definition: J ^ f(x) dx = ^lim f R R f(x) dx , provided both limits exist. This 


definition is also known as Cauchy’s principal value (orp.v.) of the integral, denoted 

fOO nb jr/j\ 

by I f(x) dx. A common p.v. integral is the Hilbert transform f- - dt , where 

J —00 J A t % 

—oo<a<b<oo, and a < x < b. A sufficient condition for the Hilbert transform 
to exist over a finite interval [a, b] is that f(t) satisfy a Lipschitz or Holder condition 
in [a, b]; i.e., there are constants A > 0 and 0 < a < 1 such that for any two points 
£ 1 , t 2 G [a, b] we have |/ (£ 1 ) — / (£ 2 ) | < A \ti — £ 2 !^. Cauchy’s p.v. integrals are 
discussed in Chapter 6. 


4.1. Infinite Range Integrals 

We discuss some methods and quadrature rules for computation of infinite range 
integrals. 

4.1.1. Truncation Method. The technique of truncating the infinite interval 
of integration is discussed, and the Riemann method is used on the truncated interval, 


187 
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which is valid if the integrand decays rapidly. We consider infinite range integrals of 
the form 

POO POO 

I\ = I w(x)f(x)dx , h= w(x)f(x)dx. (4.1.1) 

J a J — oo 

If the product w(x) f(x) tends to zero rapidly near the ‘infinite’ endpoint(s), then, by 
the Riemann sum method, we have 

I\ = lim w(x) f(x)dx = lim h(R), (4.1.2) 

R —>OG R —>OG 

/ 2 — lim w(x) f(x)dx = lim / 2 (1?), (4.1.3) 

R — >oo R — >oo 

Thus, we can truncate the range only if the product w(x)f(x) decays rapidly for large 
\x\. 

Example 4.1.1. (Delves and Mohamed 1985, p. 39) Compute 

pOO 

I\ = / e x sinx dx = 0.5, 

Jo 

dx 7 r 

I 2 = / -o —77^7 dx = -= 0.157079632. 

Jo X 2 + 100 2 

We truncate the upper limit at a value R > 0, and for fixed R we use an 7V-point 
Gaussian rule. The results are given in Table 4.1.1. It is found that this rule gives 
good results for Ii(f) at a small value of IV (at R = 15 and N = 16), but for / 2 (/) 
it is not that satisfactory even for R = 200 at IV = 32. Also see Example 4.1.6. 


Table 4.1.1. Truncation Method. 


R 

N 

h (R) 

R 

N 

h(R) 

5.0 

8 

0.502275 

5.0 

4 

0.046356 

10.0 

8 

0.500314 

10.0 

4 

0.078540 

15.0 

16 

0.500000 

15.0 

4 

0.098279 




20.0 

8 

0.110715 




25.0 

8 

0.119029 




50.0 

16 

0.137340 




100.0 

16 

0.147113 




200.0 

32 

0.152084- 


4.1.2. Gaussian Rules. Assuming that the integrals over infinite intervals are 
convergent, there are two major methods for their computation: (i) If the integrand 
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is such that the integral remains bounded in magnitude from some finite value to 
infinity by some constant £ > 0, we use a quadrature (like the Gauss-Legendre rule) 
for the remaining finite interval; and (ii) we develop a quadrature rule especially for 
the infinite interval. The first method has been considered before and does not need 
any further consideration. For the second method where we compute integrals over 
infinite and semi-infinite intervals, we will use such a weight function w(x) that would 
maintain the convergence of the integral of w{pc) f(x), where f(x) is a polynomial 
of arbitrary degree. 

Gauss-Laguerre Rule (§3.2.3). If the interval is semi-infinite, say (a, oo), 
we will take a = 0 for convenience, and choose the weight function w(x) = e ~ x . 
This demands that the sequence of polynomials that we use must be orthogonal over 
(0, oo) with respect to e~ x . The polynomials that meet this requirement are the 
Laguerre polynomials L n (pc) of degree n, with the leading coefficient A n = (—l) n . 
Thus, the Gauss-Laguerre quadrature rule is 


poo n 

/ e~ x f{x)dx = 'Y'wifixi) + E n , 

i=1 


where Xi are the zeros of L n (x), and 

(n!) 2 


Wi = 


E n = 


C' E r n ( Xi ) 

(n!) 2 


(2 n)! 


/ (2n) (G for £ & (0, oo). 


(4.1.4) 


(4.1.5) 

(4.1.6) 


Note that / e x L 2 (x) dx = (n!) 2 = 7 n . Some of the weights Wi and nodes 
Jo 

for the Gauss-Laguerre rule are given in Table A.7. 

Example 4.1.2. Compute I = J 0 °° e~ x x 3 dx = 6 by the Gauss-Laguerre rule 
with N = 2 which is exact for all polynomials of degree at most 3. For N = 2 we 
have L 2 (x) = x 2 — Ax + 2 and its zeros are at £i } 2 = 2 ± \/2. The weights are given 
( 2!) 2 

by Wj = -—-g ’ 3 = 1? 2 (see §3.3.3). Thus, = \ (2 =p y/2). Then the 

0 W 2 (0)] 

Gauss-Laguerre rule gives 

I — — ^2 — y/2^ ^2 + \/2^ + ~ ^2 + \/2^ ^2 — \/2^ = 6, 


which is the exact value of If. ■ 

Example 4.1.3. Compute I = ff° e~ x x 3 dx by the Gauss-Laguerre rule with 
N = 2. Using the values of and Wj from Example 4.1.2 we find that 


1 = 


Hi (2-^(2 + v / i) > + T+'H( 2 -A] 


16 

1 

e 
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which is the exact value of If. ■ 


Gauss-Hermite Rule (§3.2.4). If the interval is (—oo, oo), we choose the 

weight function w{x) = e~ x . Then the Hermite polynomials H n (pc) of degree 

2 

n, with the leading coefficient A n = 2 n , are orthogonal to e~ x over the interval 
(— 00 , 00 ). Thus, the Gauss-Hermite quadrature rule is 



n 

^ ^ f (%i) T Em 

i=1 


(4.1.7) 


where Xi are the zeros of H n (x), and the weights are given by 

2 n+1 n! ^ 


Wi = - 


H n -\-\{xi) H f n {x{) 


jBn = TUU! /(2n)(€) ’ f °Ue (- 00 , 00 ). 


(4.1.8) 

(4.1.9) 


f°° 2 

Note that / e~ x H 2 (x) dx = y/iv2 n n\ = 7 n . Some of the weights Wi and nodes 

Jo 

Xi for the Gauss-Hermite rule are given in Table A. 8 . 

Example 4.1.4. Compute 


1 = 



3y^7T 


4 5 


using Gauss-Hermite rule with N = 3. Here, Hs(x) = Ax (2x 2 — 3) and its zeros 
are = 0, and £ 2,3 = =F\/3/2. The weight are 


2 4 3! y/lT 

[^te)] 2 ’ 


3 = 1,2,3. 


Thus, w\ 


20? , \/tt u 

-, and W 2 =-= 1 C 3 . Hence, 

3 6 



which is the exact value of If. ■ 

Example 4.1.5. Compute J 0 °° x 7 dx, using n = 3 in the rule (4.1.4). From 
Table A .8 we find that 


rOO 

/ x 7 e~ x 

Jo 


dx « (0.711093) (0.415775) 7 + (0.278518) (2.294280) 7 


+ (0.010389) (6.289945) 7 = 4139.9. 
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(3!) 2 

The exact value of the integral is 7! = 5040. The error is E 3 = —— 71£ = 252^, 

6 ! 

where £ G (0, oo), so it cannot be bounded. But the huge error is not surprising. 
This rule should be avoided if the derivative in the error term cannot be bounded. 
The better method appears to be the Gauss-Legendre rule. Note in passing that the 
Gauss-Laguerre rule for n = 4 gives a little better result as can be seen from the 
following computation: 


rOO 

/ x 7 e~ x 

Jo 


dx « (0.603154) (0.322548) 7 + (0.357419) (1.745761) 7 


+ (0.003612) (7.085810) 7 + (0.000023) (12.640801) 7 = 4443.3. 


But with n = 5, the computed value 
(0.521756)(0.263560) 7 + (398667)(1.413403) 7 

+(0.075942) (3.596426) 7 + (0.003612)(7.085810) 7 + (0.000023)(12.640801) 7 
= 4.49735386 x 10 6 , 
is way off the exact value. ■ 

The midpoint and trapezoidal rules are useful in computing with high accuracy 
integrals of the form je~ f f(t)dt and other integrals that decay rapidly for large 
\t\ (see Goodwin 1949). These rules are used to derive quadrature formulas with 
exponential convergence for finite and semi-infinite intervals. 

Example 4.1.6. To compare the accuracy of the midpoint and Gauss-Hermite 
quadrature Squire (1987) considers the integral 

rOO 

/ e~ l cos(2fc£) dt = ypK e~ k . (4.1.10) 


Let 


V(x,y)= y - J_ 


-oo (X ~ t) 2 + y 2 


dt = 


I/" 

^ J - ( 


Z — t 


■ dt 


(4.1.11) 


denote the Voigt function which is used in spectroscopy. Note that the integral 

r i e~ f2 i 

^ < — / - dt \ is known as Dawson integral. Humlecek (1979) has found 

J _ 00 z-t J 

that the integrals in (4.1.10) and (4.1.11) are difficult to compute for small x and y 
because of the poles at t = x ± i y. Squire (1987) uses the quadrature formula 


f 




N 


z ~ f ti z ~ tk 


where and tk denote the weights and nodes, respectively. Then the formula 


7°° 2 2 N 

/ e~ f cos(2 kt)dtzze~ k A t 

^-°° k =l 


(— sin (2 ktk) + i cos (2 kt^)) 
(x + t k )+i(y + k) 


2005 by Chapman & Hall/CRC Press 









192 


4. IMPROPER INTEGRALS 


becomes useful in computation if k is chosen such that the quadrature rule gives 
desired accuracy for the integral (4.1.10). Squire finds that for 12 nodes the midpoint 
rule computes (4.1.10) more accurately than Gauss-Hermite rule, and his method 
gives accurate results for z = 0 . ■ 


4.1.3. Mapped Finite Range Rules. The weight functions for both Gauss- 
Laguerre and Gauss-Hermite quadrature rules decay exponentially. They appear to 
be suitable for the first integral in Examples 4.1.1, 4.1.2 and 4.1.3 but not for Example 
4.1.5. Other infinite range rules can be produced by using the method of variable 
transformations. This is done in two ways: Either we map the integral /^(/) onto 
/Ii (/), or we map a rule defined on [— 1 , 1 ] onto the required interval of integration. 
We will discuss the latter method because it tells us more about the types of integrand 
for which the particular mapping is appropriate. For example, consider the integral 

POO 

1(f) = f( x ) dx. (4.1.12) 

J a 


If we use the transformation x 
a + a > 0 , then we find that 


2 (ci ot) 
u-\-l 


a , where a is arbitrary but such that 


1(f) = 2 (a + a 



F{u) 

(u + l ) 2 


du , 


(4.1.13) 


where F(u) = f(x). Let Wj}, j = 1,... , N, be the nodes and weights of an 
7V-point Gauss-Legendre rule. Then we have the rule 


If 


N 

/tv — 2 (a + a) E Wj 

3 = 1 


fe + i) 2 ’ 


(4.1.14) 


which is exact if 


F(u) 


(U + l) 2 

functions F(u) = (u + l) fc , k = 2,3,... , 2 N 
known as the Gauss-Rational rule , becomes 


is a polynomial of degree < 2 N — 1 , i.e., for the class of 
1. For this class the Gaussian rule, 


where 



N 

3 = 1 


MG 

G + 1 ) 2 ’ 




2 (a cdj 

17TT’ 


Wa 


2 (a + a) Wj 

(& + 1) 2 


(4.1.15) 


(4.1.16) 


^ and Wj being the Gauss-Legendre nodes and weights. This rule is better suited for 
the second integrand in Example 4.1.1, which are known as ‘long-tailed’ integrands. 
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Example 4.1.7. (Delves and Mohamed 1985, p. 43) Compute the second 
integral in Example 4.1.1 by the Gauss-rational rule. The results of the Gauss- 
Laguerre rule with different values of the parameter a are given in Table 4.1.4. The 
best results are obtained for IV = 48 and a = 0.05 which give an accuracy of about 
2 x 10 -4 . The results obtained from the Gauss-rational rule are compared with the 
Gauss-Laguerre rule for a = 0 and values of a as shown in Table 4.1.5. 

Table 4.1.4. Gauss-Laguerre Rule with different values of a. 


N 

a = 1.0 

a = 0.5 

a = 0.2 

a = 0.1 

a = 0.05 

2 

0.0551436 

0.0909624 

0.1274653 

0.1493257 

0.1479445 

4 

0.0927649 

0.1215651 

0.1423088 

0.1501190 

0.1610400 

8 

0.1228893 

0.1394927 

0.1499906 

0.1533760 

0.1561286 

16 

0.1401240 

0.1485416 

0.1536576 

0.1553738 

0.1560471 

32 

0.1487845 

0.1529250 

0.1554170 

0.1562483 

0.1566703 

48 

0.1516143 

0.1543449 

0.1559855 

0.1565326 

0.1568056 


The exact value is 0.157079632. 


Table 4.1.5. Gauss-Laguerre and Gauss-Rational Rules. 


N 

Gauss-Laguerre (a = 0.2) 

Gauss-Rational (a = 10) 

2 

0.1274653 

0.1500000 

4 

0.1423088 

0.1568627 

8 

0.1499906 

0.1570794 

16 

0.1536576 

0.1570796 

32 

0.1554170 


48 

0.1559855 

■ 


4.2. Improper Integrals 

The formula 



dx ~ h 


+oo 

E 


n=—oo 


(4.2.1) 


is accurate even for large values of h; for example, for h = 1, the error is one unit in 
the fourth decimal place, i.e., it is of the order 10 -4 . The quadrature formula using 
central differences for integration over one subinterval is 


pa+h 7 oo u( 2k )(b\ 

J f(x)dx&-[f(a)+ f(a + h)]+hJ2 ^fc)! 


[f(a + h) - f(a)], 
(4.2.2) 

where (fc) denote the Bernoulli numbers (see §2.2.2). By adding such formulas 
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over m subintervals, we get 

na+mh 


na-\-mn 

I f (x) dx ~ h /(a) + /(a + h) + • • • + ^ /(a + m/i)] 
J a 

o° r>( 2 &)/7,\ 

+ (2A:)! / xg2fc ~ 1 [/( a + wfe ) ~/( a )]~ 


(4.2.3) 


Now, the function e -a: and its differences approach zero rapidly as x —> =boo, while 
the series (4.2.2) does not converge but is asymptotic, and the error caused by the 
approximation (4.2.1) can be obtained from the magnitude of the remainder term. If 
n — 1 terms are taken in the infinite series (4.2.2), the remainder is given by 


R n = h 2n+1 GAG a - nh < f < a + nh. 


d 2n 


(4.2.4) 


For f(x)=e * 2 wehave / (2n) (£) = e 4 =e 4 H 2n {£,), where H 2n (Q are 
the Hermite polynomials. Thus, for large n we have 


f (2n H0 ~ (-1)" 2 2n+1/2 0)” e~ e/2 cos 2^, (4-2.5) 

r^( 2 n) / \ 

B 2n ( n ) 


(2n)! 


(—l) n x n 3 / 2 7t 5 / 2 2 2n+1 . 


Substituting (4.2.5) and (4.2.6) into (4.2.4) we get 

Rn ~ - 


2 3 / 2 /i / nh 2 \ n 


7.3/2 7J-5/2 V e 


e ^ ! 2 cos 2£y/n, 


(4.2.6) 


(4.2.7) 


which implies that even if h is taken small, R„ will eventually increase without limit. 
Thus we have the quadrature rule 


/ OO 00 

f(x)e~ x dx = h ^ f(nh)e~ nh — E(h). 

-OO ~~ 


(4.2.8) 


Without loss of generality, we take f{x) to be an even function. Then integrating 

fix') (3 X X7T 

-——7- around a rectangular contour with vertices at ±00 ± —, we find that 

1 — e~ z% ' KX i tl h 


/ Too 77T /h p-oo+in/h \ r( \ -x 2 00 

+ / ) I _ p -2iitx/h dx = h £ f ( nh ) 1 

-OO — 77T / h j XooXi'K / H / I ^ n= _ OG 


-tA/P 


' —OO — 77T / h 


(4.2.9) 
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Hence, 


f^oo — iTr/h 


h f(nh) e - ” 2 ^ 2 — f 

D J ~ 

f+^-^/h f( x 
J-oc-iv/h — -e~ 2 ™/ h 

'L 


f(x)e~ x dx 

n= — oo J-oo-iir/h 

f+oo-i7r//i j e —x 2 e —2Kix/h p — oo+iir/h 


■ dx 


i. 


f(x) e 


/7 1 _ p—2'Kix/h 

00 + i7T//l ° 


dx 


OO-l'K/h n/\ e - X 2 

= 2 / „ . /7 -- dx , since f(x) is even. 


’ —oo —Z7T / H 


g2i:ix/h _ 2_ 


If f(x) has no poles between the real axis and the lines x = ±m/h, then 


/ oo 

f(u — iir/h) ( 

-oo 


du. 


(4.2.10) 


(4.2.11) 


For example, if f(x) = l,then E(h) = 2^/tt e 71 ' 2 / /l2 . Note that E(/i) « 1.8 x 10 4 
for h = 1, and E(/i) « 2.5 x 10 -17 for h = 0.5. A simpler expression for error is 

E(h) = 2X^e-^ /h2 f{m/h), (4.2.12) 

although this error estimate is not very effective if f(x) —> oo rapidly as x —> oo. 

2 

For example, if f(x) = x 2 , then from (4.2.12) we get E{h) = —2^/ir ^ e _7r ^ 

( 7T 2 1 \ 2/2 

— — - J e _7r . If f(x) is of 
the form f(x) = (j){x) cosh kx , then (4.2.12) is replaced by 


E'(ft) ~ 2v / 7re 77 +/c / 4 (j)(i7rh). 

Examples 4.2.1. Some other examples are: 

/ OO 2 

cos xe~ x dx = e _1//4 , the error bound is 

-oo 

E(h) ~ 2 y / 7 r e _7r2 / ,! ' 2 cos( 7 r/ft) ~ e 7r/h ~ 7r2/h2 

/ OO ^ 

t 2 cos x dx = - e -1//4 , the error bound is 

-oo ^ 

E(h)~^(^)e n/h ~* 2/h2 . 

/ oo 2 

Jo(x)e _a: dx = 7o( 1/8), the error bound is 

-oo 

E(/i) ~ 2^/ir Io(tt/ h) e 


(4.2.13) 


3. For 


^ Jf!i e */h-ir 2 /h 2 
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4. For 


cos xu Jo(yu) du , the error bound from (4.2.12) is 


E(h) ~ Y (h.y /2 e M^+y)/h-n 2 /h\ 


5. For / (x 2 — t>) e ^ [Vo (|a + for|) + V (|a — bx\) ] dx, the error bound from 

Jo 

(4.2.12) is 

E(h) + e^l h ~^l h \ 

Note that in all these five examples, the exact value of the integral is known. ■ 

We start with the Euler-Maclaurin summation formula (2.2.8) and obtain 

A/ — 1 , 

^2 hf(n6) = / Nhf(x) dx - - [f(nh ) - /(0)] 


- (-1 )^B k 2k ( d_^ 2*-i *=** 
^ (2k)! \dx) 1 x =o ’ 


(4.2.14) 


where B\~ are the Bernoulli numbers. This formula reduces to the trapezoidal rule 
if the term with one-half the endpoints is included; then the error is of the order h 2 . 
It also reduces to the Simpson’s rule if we add two such series at alternate nodes so 
as to cancel out the ti 2 terms; then the error is of the order h 4 . Moreover, if the first 
derivative of / vanishes at the endpoints of the integration, then the sum (4.2.14) 
differs from the integral in order h p+2 , where p > 1 is an integer. Thus, we can take 


1(f) = f(x)dx « Y h f ( nh )• 


(4.2.15) 


We assume that the integrand f(x) goes to zero at the endpoints fast enough so that 
both the integral and the sum converge, and we assume that / is an analytic function 
on the real axis on which we are integrating and also within the strip |^{x} < a in 
the complex z-plane. Now, consider the integral representation 


f(x) dx = 

g2:wixjh ^ 2-~/ — ’ 


(4.2.16) 


E- = 


f(x) dx 

g2i:ix/h _ ’ 


f(x) dx 

g2i:ix/h _ 


/(*) ( 4 - 2 - 17 > 
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Then ^ = 1(f) + E, where the error E is given by 


E = 


L 


■+oo —ie 


f(x) dx 


— oo —is 

— A 


g 2i:ix/h 


lx f 

- + i 


'+°°+ ie f(x) dx 

— 00 + 7 £ 


g—27 xix/h 2_ 


rOO nOO 

/ f(x — ia) e _271 W^ ^ x _^_ /(# _j_ ^a) e 2 ' K ' lx / h ^ x 

^ J — oo J — oo 

= o(e~ 2 ™/ h ), (4.2.18) 


which shows that the error decreases faster than any power of h. Note that halving 
the interval doubles the number of correct decimal digits in the result. 

Example 4.2.2. Consider f(x) = ---. This integrand has singularities 

e x + e -x 

at x = inr/2, so a = ir/a, and E ~ e ~ 7r ^J N / 2 . This is rapid convergence. For 
iV = 10 the error is about 10 -3 , and for N = 100 it is about 10 -10 . ■ 


Example 4.2.3. Consider f{pc) 


--. The value of a = 1, and E « 

1 T x z 


4.2.1. Method of Variable Transformations. This method is known to 
compute improper integrals provided a proper choice of the mapping function which 
is ingeniously obtained for each integral on a case-by-case basis. A general method 
for variable transformations is given by Schwartz (1969), which is applicable to a 
large class of improper integrals. In this method the mapping function is chosen such 
that the singularities of the integrand are moved to infinity; this changes the improper 
integral into a convergent infinite integral which can be computed by the trapezoidal 
rule with an equal step size h. The application of such a trapezoidal rule over the 
interval (—00,00) provides an unusually high accuracy provided the integrand is 
analytic over this interval except the endpoints (see Goodwin 1949). 

We will derive quadrature formulas for the computation of improper integrals 
of the form (i) J ^ f(x) (1 — x) -a (l + x)~@ dx, a, (3 < 1 , and (ii) J ^ f(x) dx, 
where for integrals of type (i) we use variable transformations like x = tanh u and 
x = erf u, followed by the trapezoidal rule, whereas for integrals of the type (ii) we 
use the variable transformations like x = sinh u and x = tan u, followed by the 
trapezoidal rule. The error bounds for these quadrature formulas are obtained by the 
method of contour integration. 

Let Ia(f) = f( x ) dx, where a and b may be infinite. It is assumed that f(x) 
is analytic in a certain domain that includes the line segment (a, b). The method 
of variable transformation is as follows: We make a change of variables by setting 
x = <j)(u), where <j)(u) is analytic in a certain domain and maps univalently the line 
segment c < u < d onto a < x < b, where c and d may be infinite. Then the 
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transformed integral is 


I = 


r d 

J g(u) du , where g(u) = f(cj)(u)) <j)'(u). (4.2.19) 


The function g(u) is also analytic in a certain domain that includes (c, d ). Then we 
apply any quadrature rule to (4.2.19), which gives 


(4.2.20) 


I « I w = J2 w jg(xj) 

3 

= E w o ft ft ft / ft ft ft) = E ftft ’ 

3 3 

where = <f> (xj ) are the nodes and ujj = Wj <p f (xj ) are the weights of the new 

f d 

quadrature rule. The error in formula (4.2.20) is E = / g(u)du — E wjgftft, 

ft j 

which is written in the contour integration form obtained by substituting Cauchy’s 
integral representation for g(u) as 

E= — 

2z7T 

where 


(j) 4>(w) g(w) dw, 

(4.2.21) 

Jc 


du w j 

W — U ^ W — Xj 

j j 

(4.2.22) 


The function (j){w) which is defined in the complex r^-plane is known as the char¬ 
acteristic function of the quadrature error E. The contour C is traversed counter¬ 
clockwise and it encloses the line segment (c, d). The contour integration in (4.2.22) 
is evaluated by the saddle point method (see, e.g., Carrier et al. 1966, p. 258ff.) If 
we use the inverse transformation z = 4>(w), then formula (4.2.22) yields another 
formula for the quadrature error: 


E = 




(4.2.23) 


where the function <f(z) = f(w) is defined in the complex z-plane, and the path C is 
the inverse image of C from the w-plane into the z-plane under the map z = 4>(w). 
Note that formula (4.2.23) gives the quadrature error directly in terms of the given 
function f(z). Thus, we can regard <f(z) as the characteristic function of the original 
formula (4.2.20) and choose between formula (4.2.22) and (4.2.23) according to 
convenience. 

Now, we consider I = f(x) dx, where f(x) may have singularities at one or 
both endpoints. 
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Case 1. The Tanh-Rule. Let the mapping function be x = tanhxx. Then 


I = 


/: 


/(tanhxx) sech 2 (u)du, 


which, after applying the trapezoidal rule with an equal mesh size, gives the quadrature 
formula 

oo 

I w = h ^ /(tanhnft) sech 2 (nh). (4.2.24) 

n= — oo 

This formula is known as the Tanh-Rule. The error in (4.2.24) is given by 


E = 


- [ 4>(w) f (tanhrc) sech 2 (rc) dw, 

2X7T Jc 


(4.2.25) 


where <j){w) is given by (Takahasi and Mori 1971) 


—2m 


4 >( w )={ 


1 — exp(— 2m w/h) 
2m ^ 

1 — exp( 2 i 7 r w/h) 


2m ex.p(2mw/h) if ^s{w} > 0 , 
■2m exp(— 2mw/h) if ^s{w} < 0 . 


(4.2.26) 


The contour C consists of two lines which run along both sides of the real axis. The 
inverse characteristic function cj)(z) in the z-plane is 


cj)(z) = 0 (arctanh z) ~ < 


[2i7r(if 9(4 > o, 

1 + z\- i7r / h 


—2m 


1-z 


(4.2.27) 


if ^s{z} < 0 , 


which gives 

E = 2Jtt J c ^ dZ ' (4.2.28) 

Note that since arctanh z is multiple-valued, each strip domain {w : —tt/2 + 

mu < {w} < 7r/2 + m7r}, m = 0, ±1, ±2,..., is mapped onto the entire z- 

plane cut along — oo, — 1) and (1, oo). This means that the characteristic function 
(j>{z), defined by (4.2.27), and the integrand in (4.2.28) should be defined on the 
Riemann surface such that the path C may also run outside the principal sheet. The 
contour \<j)(w)\ = £ in the w -plane is approximately a pair of straight lines given 

by = zb — log which implies that the contour \4>(z)\ = £ is a pair 

of circular arcs x 2 + (y zb cot 2co) 2 = esc 2 (2co), which meet at z = zbl, where 
z = X + i y, and c 0 = — log (-^-). 
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According to Haber (1987) the tanh-rule approximates iti(f) by 


InU) =h Y 1 


/(tanh(jfe/2)) 

2 cosh 2 (j/i/ 2 ) ’ 


h = fo(n) ~ cn 1//2 . 


(4.2.29) 


The rule is very accurate, and its error is 0(e -c ^) for some c > 0, even when the 
integrand is unbounded at an endpoint of the interval of integration. Let denote the 
region in the complex plane bounded by two circular arcs passing through — and + 1 , 
one arc in the plane > 0 and the other in < 0 such that each arc makes an 
angle d with the real x-axis at each point ±1. It is assumed that d > 0, / is analytic 
in Ad, and f r \f\ is bounded along some sequence of contours {T n } that approach 

dAd , and f(x) = 0(( 1 — x 2 ) a 1 ) for some a > 0 as x —> ±1 from inside (—1,1). 

\ x 

Let us denote i/j(x) = tanh(x/2), and let (j)(x) = i/j~ 1 (x) = In --. Then 


/; 


f(t)dt = h ^(kh)f(iP(kh)) 

k= — n 

= o(V v ™*^ 


j m 

V h 


(4.2.30) 


-y P7TX gj^j^ 

uniformly in x, where a(x) = — / - dt is a form of the sine integral, and the 

7T JO t 

log n 


quantity h depends on n such that h(n) = a/— 

an 


2 an 


The formula (4.2.30) 


/. 


needs a subroutine for computing the above sine integral. An alternative formula is 

/ (t) dt = h 'jr it, VAN / WTN) [h + a ( k ~j)\ sinc (^^) 

k=—nj=—n 

+ [h it 0 h ) f idPOh)) rj(x) — it ri(il>(kh)) sine j 

j=—n k=—n 

+ 0(ne~ V (4.2.31) 


t . sm 7 TX 

where sme x = -. 

7 TX 

4.2.2. Types of Inherent Errors. In any quadrature rule that is obtained 
by a variable transformations method there is an inherent error which is unavoidable 
irrespective of the integrand, even when the integrand is a constant. To explain this 
situation, we will consider the integrand f(x) = (l — x 2 ) a fi(x), a < 1 , where 
fi(x) is regular in a certain domain that includes the interval [—1,1]. Then, we use 
(4.2.25) and deform the contour C such that we can use the saddle point method. 
Since the integrand in (4.2.25) which is 

F(w) = (j)(w) -— 2 — (l —tanh 2 rc) a /i(tanhrc), (4.2.32) 

cosh w 
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has singularities (poles or branch points) at w = =bz7r/2, we cannot move the path C 
beyond these points. Also, for small values of h the variation of (4.2.32) is dominated 
by the rapid decay of \f(w)\ « 27rexp(— 2tt |S{w}|//i), i.e., for large |S{w}|//i, 
we should take the path C close to these singularities, which gives a rough estimate 
for the error as 

E(h ) ps {0(=bz7r/2)| ps 2tt exp (—7 r 2 /h) . 

A precise error estimate by the saddle point method is A • 2tt exp (—7r 2 //i), where 
A is a factor of order 1 which depends on a. In the Tanh-rule, this amount of error 
cannot be avoided even when a = 0, because the singularity is also contained in 
4>(w) / cosh 2 w. We can expect a larger error if f(z) has singularities outside the real 
axis. 

Another type of inherent error is the truncation error Et which is due to the re¬ 
placement of the infinite sum Y^=-oo f° rmu l a (4.2.24) by a finite sum Y^=-n/ 2 ‘ 
For a given number of terms TV, this error increases when h is decreased, which results 
in a decrease in E(h) = 2tt e _7r ! h . Thus, we can have an optimal value of h. For 
example, for the above function f(x) = (l — x 2 ) a < 1, the truncation 

error is given by Et ~ e -f i -° t ) Nh m This leads to the optimal value of h as 




Substituting this into the value of E(h) we find that the dominating factor in the 
truncation error is 


E n k 27re _7r V (1-a) 


(4.2.33) 


where N is the number of nodes. 

Case 2. The Erf-Rule. By taking the mapping function as x = erf u = 


jl r 

Jo 


e t dt , we get 


1 = 


v* J- 


/ oo 

/(erf u ) < 

-OO 


du. 


(4.2.34) 


which, after applying the trapezoidal rule with an equal mesh size, gives the quadrature 
formula 


p h 2 2 

I w = —= ^ / (erf nh) e~ n h . (4.2.35) 

v n=—oo 

This formula is known as the Erf-Rule. For this rule, the dominating factor in the 
truncation error is (see Takahasi and Mori 1973) 


E n 


27re - 3 .4 


(4.2.36) 
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Thus, the Erf-rule is generally better than the Tanh-rule for integrands of the form 
f ( x ) = (i — x 2 ) a f\ (x), where fi (z) is regular in the entire z-plane. The inherent 

2 / t 2 

error for this rule is of the order of e _7r even when a = 0 . 

Case 3. The IMT-Rule. This rule was developed by Iri, Moriguti and 
Takasawa (1970). It is obtained by the mapping function 



which maps the interval (—1,1) onto itself. Since all derivatives of are zero at 
± 1 , we apply to the transformed integral the trapezoidal rule with an equal mesh size 
of h = 1/N. The rule so obtained is known as the ITM-Rule. It is shown that for 
integrands that are of the same form as above, the inherent error for this rule is 


E n « 2tt e - V 477 (1-a) N , 


(4.2.37) 


This rule is as good as the Tanh-rule if the integrand f(x) is regular except at z = ±1. 
Example 4.2.8. (Takahasi and Mori 1973) Consider 


f dx 

i (x — 2){x — 1) 1 / 4 (1 + x ) 3 / 4 


-1.949054456. 


The errors in the above three quadrature rules are presented in Table 4.2.1. It is 
obvious from these results that the Erf-rule is superior to the other two rules for the 
same number of TV, although the Tanh-rule is simpler to generate the sampling points 
and weights. In this example the error due to the simple pole at x = 2 is prominent as 
compared to that due to the singularities at x = ±1, except in the case of the Tanh-rule 
where both errors are of almost the same order of magnitude, since the segments of 
the real axis defined by y = 0 , \x\ > 1 are mapped onto the line ^{^} = 7 r /2 + m 7 r 
on which we have |0(u?)| ~ 2tt e _7r ! h . ■ 

Example 4.2.9. (Takahasi and Mori 1973) Consider 



COS 7 TX 

(1 — x) 1 / 2 


-0.69049458699. 


The errors in the above three quadrature rules are presented in Table 4.2.2. In this 
example the main source of error is the saddle point which is due to the fast growth of 
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| cos 7 tw | and the rapid decay of | (j){w) | along both directions of the imaginary axis. ■ 
Table 4.2.1. Errors in Tanh-Rule, Erf-Rule, and IMT-Rule. 


N 

Tanh-Rule (4.2.33) 

Erf-Rule (4.2.36) 

IMT-Rule (4.2.37) 

5 

1.87396(—1) 

1.92742(—2) 

1.19379(—1) 

10 

4.37433(—2) 

6.43753(—4) 

2.31187(—2) 

50 

9.42716(—5) 

1.358082(—11) 

2.2652(—5) 

100 

9.468868(—7) 

1.908727(—18) 

1.26041(—7) 

150 

2.774055(—8) 

3.4156572(—24) 

2.34692(—9) 

200 

1.414432(—9) 

2.532692(—29) 

8.16642(—11) 

250 

1.027632(—10) 

4.883947(—34) 

4.23737(—12) 


Table 4.2.2. Errors in Tanh-Rule, Erf-Rule, and IMT-Rule. 


N 

Tanh-Rule (4.2.33) 

Erf-Rule (4.2.36) 

IMT-Rule (4.2.37) 

5 

4.3743(—2) 

4.28295(—3) 

2.31187(—2) 

10 

5.5891(—3) 

5.5891(—5) 

2.26818(—3) 

50 

9.46887(—7) 

1.26148(—14) 

1.26041(—7) 

100 

1.41443(—9) 

2.93543(—23) 

8.16642(—11) 

150 

9.60139(—12) 

1.68487(—30) 

2.92029(—13) 

200 

1.42697(—13) 

5.79839(—37) 

2.52837(—15) 

250 

3.49936(—15) 

6.653(—43) 

3.85184(—17) 


Remark. While computing such integrals we must be careful not to lose sig¬ 
nificant digits due to cancellation as x —> =bl. In using the Tanh-rule or the Erf- 

2 e~ 2u 

rule, if possible, we should directly set t = 1 — x = 1 — tanhxx = -—, 

1 + e Zu 

or t = 1 — x = 1 — erf u. There may also be possible underflow problems in 
computation. 


4.3. Slowly Convergent Integrals 

We will use the method of variable transformations to compute I (/) = f(x) dx 

when the integrands decay slowly as x —> oo. An example of such integrands is 
f(x) = (l + t 2 ) 5//2 . There are two cases: 
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Case 1. Sinh-Rule. We set x = sinhT/. Then 



/(sinhT/) cosh udu. 


If we apply the trapezoidal rule with a uniform mesh size h, we obtain the quadrature 


oo 

I w = h /(sinhnfo) coshn/i, (4.3.1) 

n =—oo 

which is known as the Sinh-Rule. The error in this rule is given by 

E= - [ 4>(w) /(sinhrc) cosh/c dw, (4.3.2) 

2m Jc 

where (j){w) is defined by (4.2.26). The characteristic function (j>{z) is defined in the 
z-plane by 


(j){z) = /(arcsinh z) 


2m (z + v / TT^) 2W/l if > 0, 

—2i7r (z + y/1 + z 2 ) 2z7F///l if < 0. 


The contour map of | (j>{z) | is obtained by mapping the straight lines ^s{w} = =bco onto 
h (2 7T\ 

the z-plane, where Co = — log ^— J . This map is given by the family of confocal 

hyperbolas- 5 - 1 -*— = 1 with foci at z = =b i. The map z = sinhrc 

cos^ Co sin c 0 

takes each strip W m defined in Case 1 of §4.2.1 onto the entire z-plane cut along 
(—zoo, —i) U ( 2 , 200 ). On the principal sheet of the Riemann surface, \4>(z)\ takes 
its minimum value which is approximately equal to 2tt e _7r ! h along the above cuts; 
\(j)(z) \ can never be smaller than this minimum value on the entire principal sheet. 

In this case an integrand f(z) must have at least one singularity in the entire 
z-plane either at a finite z or at infinity (where it must be an essential singularity since 
f(z) —> 0 as x —> ± 00 ). First, if there is a singularity at a finite z, then the contour 
C cannot go beyond this point; thus, the error is greater than the minimum value 
of 27re _7r ! h . If there is an essential singularity at z = 00 the modus \f(z)\ must 
grow toward some direction arg {z} 7 ^ 0, 7 r; thus, the contour C cannot be moved to 
infinity. In any case, there is an error of the order 


E(h) « 2ir e~'* 1 ! h 


(4.3.4) 


The best situation is when the integrand has all its singularities on the cuts (— 200 , — 2 ) 
and ( 2 , 200 ). 
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Case 2. Tan-Rule. If the integrand f(x) is regular at x = oo, we use the 
transformation x = tan?/,. Then we get 

/ OO 

f(x),dx= / /(tan?/) sec 2 udu, (4.3.5) 

-oo J— 7r/2 

which is a finite integral with the integrand /(tan?/) sec 2 ?/ which is a periodic 
function with period i r regular along the real axis including the points u = ±7t/2, 
provided the original integral is convergent. We apply the trapezoidal rule with 
equally spaced nodes and obtain 

A/2-1 

I w = h /(tannft) sech 2 n/z, h = 7t/TV, and TV even. (4.3.6) 

n= — N/2 

This formula is known as the Tan-Rule. Its characteristic function (j){w) is defined 
by (4.2.26), and the error is given by 

E = —f 4>(w) /(tan?/;) sech 2 w dw, (4.3.7) 


where the contour C is a rectangle of width it which is the period of tan?/;. The 
characteristic function cj)(z) in the z-plane is given by 


o = 


2/7T 


1 - 


i — — N 


A - 
2/7T 


if > 0, 


1 - 


r — ^ \ A 


if < 0, 


(4.3.8) 


which is regular over each half-plane. The path of integration C is composed of 
two closed curves, each lying in the upper or lower half-plane and enclosing all the 
singularities in each half-plane, respectively. This contour C exists even when (j>{z) 
is multiple-valued because f(z) is regular at infinity. The map z = tan w takes the 
straight lines 4>(w)\ « £ in the w -plane into a family of circles x 2 + (y — coth 2co) 2 = 
csch 2 2co, where Co has the same value as before. Thus, the error becomes smaller as 
all singularities of /(z) get closer to ±i. 


Assume that the integrand f(x) —> Oasx —> ooin such a way that lim f(x)x a = 

x^-oo 

const, where a is an integer > 2. Then the integrand in (4.3.5) vanishes at the end¬ 
points u = ±7t/2 whenever a > 2. For a = 2, this integrand remains finite, so we 
need to compute the value of lim f(x) x 2 . But this leads to a serious problem if 

x^-oo 

the function g(u) is to be computed by using a computer. In such cases we use the 
midpoint rule 


A/2-1 

i w = h Y, /( 

n= —A/2 


tan ■ 


N 


- sec 2 ^ + n^j , A" even, (4.3.9) 
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since in this rule we do not need the function values at the end of the interval. This 
midpoint rule, however, is not recommended in automatic computer codes where the 
step size is halved repeatedly until the desired accuracy is achieved. 

Example 4.3.1. Consider 



2.221441469. 


The errors are presented in Table 4.3.1. 

Table 4.3.1. Errors in Tan-Rule and Sinh-Rule. 


N 

Tan-Rule (4.2.33) 

Sinh-Rule (4.2.36) 

5 

4.3743(—2) 

4.28295(—3) 

10 

5.5891(—3) 

5.5891(—5) 

50 

9.46887(—7) 

1.26148(—14) 

100 

1.41443(—9) 

2.93543(—23) 

150 

9.60139(—12) 

1.68487(—30) 

200 

1.42697(—13) 

5.79839(—37) 

250 

3.49936(—15) 

6.653(—43) 


Example 4.3.2. Consider 

dx 


L 

L 


-oo (1 + X 2 f /4 

dx 

-oo (1 + a; 2 ) -5/4 


= 2.39628, 


= (1 + x 2 f ,A (§x + fa; 3 ) + £x 2 Fi (|, f, §; -x 2 ). 


The errors are presented in Table 4.3.2 for the first integral; and in Table 4.3.3 for the 
second integral, for which we use the sin-rule by setting x = sin u. 

Table 4.3.2. Errors in Tan-Rule and Sinh-Rule. 


N 

Tanh-Rule (4.2.33) 

Erf-Rule (4.2.36) 

IMT-Rule (4.2.37) 

5 

4.3743(—2) 

4.28295(—3) 

2.31187(—2) 

10 

5.5891(—3) 

5.5891(—5) 

2.26818(—3) 

50 

9.46887(—7) 

1.26148(—14) 

1.26041(—7) 

100 

1.41443(—9) 

2.93543(—23) 

8.16642(—11) 

150 

9.60139(—12) 

1.68487(—30) 

2.92029(—13) 

200 

1.42697(—13) 

5.79839(—37) 

2.52837(—15) 

250 

3.49936(—15) 

6.653(—43) 

3.85184(—17) 
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Table 4.3.3. Errors in Sin-Rule. 


N 

Sin-Rule (4.2.36) 

5 

4.3743(—2) 

10 

5.5891(—3) 

50 

9.46887(—7) 

100 

1.41443(—9) 

150 

9.60139(—12) 

200 

1.42697(—13) 

250 

3.49936(—15) 


4.4. Oscillatory Integrals 

Consider the integrals of the form Io°(wf) = / 0 °° w(x) f(x) dx, where w(x) is 
an oscillatory function. Numerical evaluation of such integrals involves mostly two 
cases: (i) w(x) = cos kx or sin kx , and (ii) w(x) = Jq(uox). The formulas developed 
by Filon (1928), Flinn (1960) and Clendenin (1966) are not applicable in such cases 
because of the infinite interval of integration. 

4.4.1. Summation, then Integration. The earliest attempts to numeri¬ 
cally integrate infinite range oscillatory functions were made by Hurwitz and Zweifel 
(1956), Hurwitz, Pfeifer and Zweifel (1959), Balbine and Franklin (1960) and Saenger 
(1964). These methods are based on partitioning the interval, followed by integrat¬ 
ing between the successive zeros of sin kx or cos kx , thus converting the infinite 
integral to summation. However, the problem with this method is that the resulting 
series converges very slowly. This slow convergence problem was corrected (i) by 
Fongman (1960) who used an acceleration technique which is a variation of Euler’s 
transformation; and (ii) by Sugihara (1987) who used Richardson’s extrapolation, by 

considering the integral J 0 °° e~ ax dx with a = 2 -n for n = 0,1,-An alternative 

method was provided by Toda and Ono (1978) who used e~ ax instead of e~ ax and 
then computed the integral Iq° (wf) by applying a double exponential transformation 
of the form x = exp (y — e ~ y ), followed by the trapezoidal rule. As discussed in 
§1.7.3, the Shanks accelerator technique was used by Alaylioglu, Evans and Hys- 
lop (1973) to improve upon Fongman’s method. The method of Alaylioglu et al. 
involves a partition of the interval of integration according to the half-cycles of the 

integrand into subintervals [t n , t n + 1 ], n = 0,1,2,_Thus, for 4.4.11, t n = nir/k 

for w(x) = cos kx or sin kx , and t n = nir/k for w(x) = cos kx 2 or sin kx 2 . In 
both cases a low order p-point Gauss-Fegendre quadrature formula is used over each 


2005 by Chapman & Hall/CRC Press 




208 


4. IMPROPER INTEGRALS 


half-cycle [t n , t n+ i], which is 



t -^±l r ^ Xl )+E m , (4.4.1) 


where g(x) represents a typical integrand, and m is taken at most 24. To mini¬ 
mize truncation and round-off errors, formula (4.4.1) is applied to each subinterval 
[t n , t n + 1 ], which yields the value T n = f^ n+1 g(x) dx, and the actual integrals re- 

oo 

quired are given by A = ^ But Shanks accelerator technique is applied to the 

2=1 

n 

partial sums A n = ^ T*. 

2 = 0 

Example 4.4.1. (Evans 1993) To compute 

f°° h 

I\(a,k) = / e ax sin kx dx = - 

Jo < 

the sequence {A n } is given by 


k 2 ’ 


A, = 


cr 


k 2 


\ ^_l) n_ ^l (22+l)o;7r//c 


(4.4.2) 


If the transformation e\ is applied to the sequence { A n }, it converges geometrically 

k 

to B ln = ^-—- for all n. However, by Longman’s method (Euler transformation), 

a J + k z 

we obtain a sequence which exhibits an accelerated convergence for values of a less 
than the critical value c a = fcln3/7r, but if a > c a , the convergence becomes less 
rapid. Thus, Shanks technique gives faster convergence. ■ 

Example 4.4.2. (Evans 1993) Consider J 0 °° — e ~ x2 sinx dx = tan -1 2 « 
1.107148718. The Shanks transformation e\ is applied iteratively to the sequence 
{ A n } and we obtain the sequences ei { A n }, e \{ A n }, _ Some of the initial ele¬ 

ments of these sequences are given in Table 4.4.2. The half-cycle contributions T n 
are computed over the subintervals [nir, (n + 1)tt] using 16-point Gauss-Legendre 
formula (4.4.1), and the results are compared with the Euler’s transformation which 
when applied to T n produces the sequence of partial sums S n . ■ 


Table 4.4.2. 


n 

T n 

An 

S n 

^1 {Tin} 

&2{A n } 

0 

1.148148 

1.148148 

0.574074 



1 

-0.045820 

1.102328 

0.849656 

1.107254 


2 

0.005519 

1.107847 

0.982409 

1.107141 

1.10749 

3 

-0.000809 

1.107038 

1.046562 

1.107150 


4 

0.000130 

1.107163 

0.077652 
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Example 4.4.3. (Evans 1993) Consider 



x 2 sin x dx = — Ci(7r) 


-0.0736679120464256. 


The half-cycle computations over the subintervals [(n + 1)7r, (n + 2 )tt] are done by 
using a 16-point Gauss-Legendre formula (4.4.1). The results are presented in Table 
4.4.3 (next page), where all entries must be multiplied by 10 -2 . ■ 


Example 4.4.4. (Evans 1993)Consider J 0 °° x 2 sin(100x 2 ) dx 


1 

4000 



3.13328534328875 x ICC 4 . This integral converges in the mean only. The numerical 
values are obtained by using the integrating factor e~(3x 2 as (3 —> 0. The half-cycle 
contributions T n with t n = ^/W/100 are obtained by 12 two-point Gauss-Legendre 
formula (4.4.1). The original sequence {A n } is found to be divergent. The results 
are given in Table 4.4.4 (next page), where it is found that the sequences {S n } and 
e\ {A n } converge slowly, but the sequences e\{A n } and e\{A n } converge rapidly. ■ 


4.4.2. Pantis’ Method. Pantis (1975) extends Filon’s method to infinite 
interval of integration by partitioning this interval into [0, a] and [a, oo], and then 
applies Filon’s method to the subinterval [0, a] while estimates the contribution from 
the interval [a, oo] by using an asymptotic expression for large a. Thus, for example, 


p oo pa p oo 

J f(x) sin (kx)dx = yj + J jf(x) sin{kx) dx = h(k) + / 2 (A:). (4.4.3) 


This method uses Filon’s formula with the Gauss-Chebyshev rule for I\(k)\ for the 
integral fyk) integration by parts gives 


M 


^w = E/ (,) w 

i =0 


cos ^\kx) 
k 2i+1 


x=a 


poo 

/ / (M+1 Y) 

J a 


cos ( M \kx) 
tfM+i dx 


(4.4.4) 


This method is effective for very large k but fails if the derivatives of f {x) cannot 
be easily found. 

Example 4.4.5. For Io°(wf), where w(x) = sin (kx), the integral can be 
written in terms of the sine transform as 


where 



f(x) sin (kx) dx 


oo 

^ ^ u n{x)-) 
n =0 


(4.4.5) 


u n {k) = (- i) n l J sintdt. 


(4.4.6) 
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Table 4.4.3. 


n 

T 

± n 

An 

S n 

^1 

eUA n } e\{A n ) 

0 

—9.6230(—2) 

—9.6230(—2) 

—4.8115(—2) 



i 

3.3180(—2) 

—6.3049(—2) 

—6.3877(—2) 

—7.3496(—2) 


2 

—1.6737(—2) 

—7.9786(—2) 

—7.5529(—2) 

—7.3744(—2) 

—7.3677(—2) 

3 

1.0078(—2) 

—6.9708(—2) 

—7.4305(—2) 

—7.3633(—2) 

—7.3667(—2) —7.3669(—2) 

4 

—0.6730(-2) 

—7.6439(—2) 

—7.3901(—2) 

—7.3689(—2) 

—7.3670(—2) 

5 

0.4812(—2) 

—7.1626(—2) 

—7.3614(—2) 

—7.3657(—2) 


6 

—0.3612(—2) 

—7.5238(—2) 

—7.3651(—2) 




Table 4.4.4. 


n 

T n 

An 

S n 

^1 {T^n} 

ej {A n } 

ef {An} 

ef {A n } 

0 

1.2177(—3) 

1.2177(—3) 

6.0883(—4) 





1 

—2.1650(—3) 

—0.9474(—3) 

3.7199(—4) 

2.7356(—4) 




2 

2.7998(—3) 

1.8525(—3) 

3.3292(—4) 

3.3475(—4) 

3.1236 



3 

—3.3143(—3) 

—1.4619(—3) 

3.2090(—4) 

2.9944(—4) 

3.1366 

3.1330 


4 

3.7588(—3) 

2.2970(—3) 

3.1647(—4) 

3.2324(—4) 

3.1317 

3.1332 

3.1332 

5 

—4.1560(—3) 

-1.8590(—3) 

3.1468(—4) 

3.0577(—4) 

3.1340 

3.1332 


6 

4.5182(—3) 

2.6593(—3) 

3.1392(—4) 

3.1931(—4) 

3.1327 



7 

—4.9535(—3) 

—2.1943(—3) 

3.1359(—4) 

3.0842(—4) 




8 

5.1671(—3) 

2.9728(—3) 

3.1344(—4) 
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Then using Pantis’ subdivision method, we write 

not 1 

Io°(wf) = / f(x) sin (kx) dx + — /(a) cos(fca) 

Jo ^ 

— — /'(a) sin(fca) — —^ f"(ot) cos(fca) + • • • , 

(4.4.7) 

where the asymptotic series (4.4.7) is valid for large k provided f(a) and its deriva¬ 
tives decrease rapidly. The choice of a is made by the relation ka = mir, m an 

integer. Then this produces an asymptotic series of the form ( —l) m — f(a) — 

- rC 

— /"(a) H- , in which the odd derivatives are zero. However, if we want to com- 

K 

pute J 0 °° f(x) sin (kx) dx for many values of fc, the above choice of a would require 
new function evaluations for each fc, and in that case a must be chosen independent 
of/c (Pantis 1975). ■ 

4.4.3. Piessens’ Method. To obtain a quadrature formula for 


[ f(x) sin(fcr) dx 
J a n } cos (lex) ’ 

consider the case of a function f(x) which is very smooth on [a, b] so that it can be 
approximated by a polynomial Qn(%) of high degree N. Then a quadrature formula 
has the form 


' fix) Sin(fca:) dx 
J( } cos (kx) 


n / \ sin (kx) , 
Qn{x) n \ dx. 
v y cos(kx) 


(4.4.8) 


If a = —1 and b = 1, Bakhvalov and Vasileva (1968) approximate f(x) by a 

N 

sum of Legendre polynomials Qn(x) = c j where the coefficients Cj are 

3=0 

determined by interpolation in the zeros of Tj (x). Then formula (4.4.8) becomes 

f 1 [(AT—i)/2] r— 

s ( k ) = J f(x) sin(kx) dx « ^ (-iyc 2j+1 — J 2j + 3 / 2 {k), (4.4.9a) 

,1 \.m\ rzz 


f(x) COS (kx) dx SS (-l) J C2j y — ^2j+l/2(fc), 


(4.4.9b) 


where J n (x) is the Bessel function of the first kind and order n. A drawback with 
these formulas is that they are more complicated and develop serious round-off errors 
in computation. 

Piessens and Poleunis (1971) modify the above formulas by using Chebyshev 
polynomials instead of Legendre polynomials. They use the Chebyshev expansion 
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N 


\/E-aTf (a;) = E' Cj Tj (x), and then approximate f(x) by the truncated Cheby- 
3=0 

shev series 


N 


f(x) ss a,iTi(x), 


(4.4.10) 


i =0 


which gives a good approximation even with small TV, where 


o N 

2 " £ ( 7^m ^ 
cii ~ — > r cos —— cos 
N ^ J \ N J 


m =0 


277171 

~/\T 


TV 


TV ■ 


f (cos £ m ) COS (z*T m ) , = 


(2m + 1)7r 


m=0 


2(iV+!) (4An) 


For an efficient computation of (4.4.10) one can use FFT (see §7.6). The values of 
TV are determined in the same way as in the Clenshaw-Curtis quadrature method: If 
the approximation (4.4.10) is found to be insufficient for a certain value of TV, simply 
double this value of TV. This means that only TV additional function evaluations are 
needed. The coefficients are computed at nonequidistant nodes, which poses no 

2 f 1 

problem if / is known analytically. Since Cj = — / f(x) TAx) dx, we get 

7T 


C 7 



Ti(x)Tj(x) dx, 


or 


2 W 2 !, 

C 23 = ~ a 2 i 

^ i —0 


1 


+ 


1 


2 [(iV-l)/2] 

@2j+l = ~ ^2 «2z+l 

^ %— 0 


(2i + 2j) 2 - 1 (2i — 2 j) 2 - 1 

1 


Thus, formulas (4.4.9a,b) yield 

[at/2] rl s - n ^ x ^2^^) 

j 

3 =0 


W 2] 1 

5(fe)« E'^- / 

4 —n —1 


x/TT 


(2i + 2j +2) 2 -l (2* — 2j) 2 — 1 


= y^-irC^j+i 7r J 2 j+i(fc), (4.4.12a) 


l=o 


C(fc)«£'C 2j7 rJ 2j (fc), 

l=o 


(4.4.12b) 


By Riemann-Lebesgue lemma, Cj —> 0 as j —> 00 , if f(x) is absolutely integrable 

1 (ek\ n 


on [—1,1]. Also, J n (k ) 


\/ 27 rn V2n7 


— ) as n —> 00 . Both series in (4.4.12) are 
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convergent and the terms decrease very rapidly for increasing j and j > k/2. Thus, 
these series can be truncated after M terms, where M is only slightly larger than k/2; 
this makes the truncation error negligible. The error Es and Ec in S(k) and C(k) 
are 


Eg ~ —2 sin k 


Ec ~ — 


E 

i=[(JV+l)/2] 

7 oo 

COS k CL2i 

W’ 


&2z+l 


(2i + l) 2 ’ 


E 

i=[N/ 2] + l 


respectively. Hence, as N —> oo, the quadrature formulas (4.4.12a,b) converge faster 
than the Chebyshev series for f(x). This method does not place any restriction on k. 

Example 4.4.6. To compute / Q 27r fi(x) sin(kx) dx, i = 1,2,3,4, where 


fi(x) = x cos x, f 2 (x) = x cos(50t), fs(x) = 


=, and / 4 (t) = 


\/l — X 2 / (47T 2 ) 

In x, Piesses and Poleunis (1971) compare the results from formula (4.4.12a) to those 
by Filon’s formula and Gauss rule for radix 2 values of k (i.e., k = 2 J , j = 0(1)8) for 
fi, 2 (t), and for k = 1,2,4,10, 20, 30 for fs^x) (see Davis and Rabinowitz 1967, 
where these integrands are used). They have found that the formulas (4.4.12) give 
superior results to Filon’s rule. ■ 


Example 4.4.7. (Piesses and Poleunis 1971) Consider 




1 sin (kx) 


dx with 


equidistant nodes at Xj = —1+ 0.1 j, j = 0(1)20. The results are presented in Table 
4.4.7 (next page). ■ 

4.4.4. Price’s Method. Price (1960) considers integrals of the form 


OTT N 

/ f(t) sin tdt ~ Wi f (ti ). 

Jg i= i 


For w(x) = cos (kx), we can use the cosine transform and write 

1 W 2 /t\ EE 

C(k)= / f(x)cos(kx)dx = - / /( — J cost dt + u n (k), (4.4.13) 

Jo k Jo \kJ n=Q 

where 

u n (k) = {-l) n+1 l J s in tdt, (4.4.14) 

which is similar to (4.4.6) except that a separate computation of the integral over the 
interval [0, tt/ 2] is required in (4.4.13) which can be accomplished by using Gauss- 
Legendre or Gauss-Chebyshev quadrature rules, or even a Gauss-cos formula with 
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the weight function cos t on the interval [—7 t/2,7t/ 2 and [0, tt/ 2]. The coefficients 
for the Gauss-cos rule are given in Tables A. 16 and A. 17. 

Table 4.4.7. 


k 

Exact 

Filon’s Rule 

(4.4.12a) N = 4 

1 

-0.071675 

-0.076150 

-0.071682 

2 

-0.103085 

-0.109804 

-0.103102 

4 

-0.025117 

-0.027653 

-0.025132 

10 

-0.019120 

-0.021167 

-0.019140 

20 

0.004379 

0.005748 

0.004386 

30 

0.001627 

0.000935 

0.001616 


4.4.5. Use of Sine Transform. Pies sens and Haegemans (1973) and Boris 
and Oran (1975) use the sine transform to obtain 

S(k) = f cr(t, k) sin t dt, (4.4.15) 

Jo 

where 

„«,*) = f>i> TGr 1 )- 

n=0 

This leads to the quadrature formula 

nf (- L ir L )’ I 4 - 4 - 16 * 

i =0 n=0 

where the accelerator technique is used on the infinite sum prior to integration. 

Thus, there are three basic methods: (i) the summation over the cycles (subinter¬ 
vals) is first carried out with or without accelerators and then is followed by integration. 
This is the ‘summation, then integration’ method which includes the work of Hurwitz 
and Zweifel (1956), Piessens and Haegemans (1973) and Boris and Oran (1975); 
(ii) ‘subdivision into half-cycles’ method, where integration is carried out over each 
half-cycle followed by computation of the resulting summation, mostly with the help 
of an accelerator; the work of Longman (1960), Alaylioglu, Evans and Hyslop (1973) 
and Squire (1973) discusses this method; and (iii) the ‘asymptotic expansion method’ 
together with a finite interval integrator as used in Pantis’ work (1975). 

4.4.6. Test Integrals. The following integrals are evaluated. 

n oo 

I 1= / x (1 + x 2 ) ~ sin X dx = — « 0.5778636748954609 
Jo 2 e 

rOO 

h= x~ 2 sin x dx = —Ci(7r) « -0.0736679120464256 

J 7T 
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13 = I x 1 e x / 2 sinxdx = tan J (2) « 1.10714871779409 


I3 = 


h = 


h = 


h = 


h = 


In = 


h = 


pOO 

/ x~ x 

Jo 

7r 

/ sech(2x) cos(4x) dx = — sech(7r) « 0. 

i 


0677537378498546 


x 0,1 sinxdx 


= T(0.9) sin(0.457r) = T(0.9) cos(0.05tt) « 1.055472109508566 


POO 

/ x 2 sin (lOOx 2 ) dx = | / 0 °° sin(100x) dx 

Jo 


3.133285343 x 1CT 4 


POO 

/ cos(l/x 2 ) 

Jo 


sin x 2 dx 


(Cos 2 + sin 2 + cosh 2 — sinh 2) 


« 0.1969225575949051 

7°° 

/ x (1 + x 2 ) J 0 (x) dx = iC 0 (l) ~ 0.4210244382407083 

Jo 

-3 

/ x (l + x 2 ) sin(ci;x) dx 

1/0 3tt 

- F « 0.0893190124092272 if a; = 0.5, 

64y^ 

3tt 

r « 0.1173080161711906 if u> = 3, 

64 e 6 

« 0.00098056808998029 if w = 10 


= < 


Note that the integral Iq does not converge on (0, oo), and no exact solution is avail¬ 
able. Mathematica gives this information: For the first part: 

16 = NIntegrate [x 2 * Sm[100x 2 ], {x, 0, oo}] 
the response is: 

NIntegrate::"ploss":"Numerical integration stopping due to loss 
of precision. Achieved neither the requested 
PrecisionGoal nor AccuracyGoal; suspect one of the following: 
highly oscillatory integrand or the true value of the integral is 
0. If your integrand is oscillatory try using the option Method 
->0scillatory in NIntegrate." and the result is —2.6603239458112698 x 
10 115 which is not correct. However, the command 
16 = NIntegrate [x 2 * Sin[ 100x 2 ], {x,0, oo} Method-> Oscillatory] 
yield the comment: SequenceLimit: : "seqlim": 

"The general form of the sequence could not be determined, and 
the result may be incorrectand the result 0.000313329, which in 16-point 
precision (with SetPrecision[%, 16] command) is 0.0003133285343295913. 

For the second part: thecommandI6 = Integra.te[S qrt[x\*Sin[x\/2, {x, 0, oo}] 
yields the comment: Integral ofyCcsinx does not converge on (0, oo). 
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4.5. Product Integration 


We discuss some examples of the method of product integration, discussed in §3.7, 
which are relevant to infinite range integrals. 


Example 4.5.1. (Rabinowitz et al. 1987) Compute / 0 °°e x f(x) dx, where 
f(x) is taken as f\{x) = e x (l + x 2 ) , f 2 (x) = cost, f${x) = sin5T, and 

U{x) = (1 + 0.02 x) 1 , respectively, using positive interpolatory Gauss-Laguerre 
rules with k nodes, k = 2,... ,20. The results are given in Table 4.5.1. 

Example 4.5.2. Compute e~ x2 f(x) dx, where f(x) is taken as fs(x) = 
sin 2 x, fe(x) = (x 2 — l) \x\ In |rr|, fr(x) = x 2 e x , and fs(x) = cos4t 2 , respec¬ 
tively, using positive interpolatory Gauss-Hermite rule with k nodes, k = 3(2)37. 
The results are given in Table 4.5.2. 


Table 4.5.1. 


k 

/iW 

/260 

h(x) 

U(x) 

2 

1.261 

0.35 

0.59 

0.98064 

3 

1.487 

0.39 

0.57 

0.9807562 

4 

1.488 

0.39 

0.56 

0.9807562 

5 

1.449 

0.508 

-0.75 

0.980755506 

6 

1.533 

0.516 

- 0.12 

0.9807554977 

7 

1.509 

0.50095 

0.73 

0.9807554965 

8 

1.508 

0.50104 

0.68 

0.9807554965 

9 

1.509 

0.49913 

0.17 

0.9807554965 

10 

1.523 

0.50020 

0.38 

0.9807554965 

11 

1.527 

0.499976 

0.307 

0.9807554965 

12 

1.526 

0.499977 

0.303 

0.9807554965 

13 

1.532 

0.5000040 

0.2955 

0.9807554965 

14 

1.537 

0.49999965 

0.2962 

0.9807554965 

15 

1.541 

0.500000017 

0.296155 

0.9807554965 

16 

1.545 

0.4999999996 

0.29615682 

0.9807554965 

17 

1.548 

0.5000000000 

0.29615678 

0.9807554965 

18 

1.551 

0.5000000000 

0.29615678 

0.9807554965 

19 

1.554 

0.5000000000 

0.29615678 

0.9807554965 

20 

1.557 

0.5000000000 

0.29615678 

0.9807554965 

Exact 

7r/2 

0.5 

5/26 « 0.19230769 0.980755496569 
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Table 4.5.2. 


k 

h{x) 

h{x) 

h( x ) 

fs{x) 

3 

0.586 

0.013 

1.47 

0.1065 

5 

0.537 

0.110 

1.66 

0.1156 

7 

0.553 

0.116 

1.713 

0.1104 

9 

0.56014 

0.568 

1.706876 

0.1158 

11 

0.560204 

0.578 

1.70690664 

0.1160 

13 

0.56020235 

0.566 

1.706906845 

0.1135 

15 

0.56020234 

0.565 

1.706906845 

0.1134 

17 

0.5602022526 

0.405 

1.706906846 

0.5859 

19 

0.5602022597 

0.466 

1.706906846 

0.6059 

21 

0.5602022594 

0.438 

1.706906846 

0.6949 

23 

0.5602022594 

0.435 

1.706906846 

0.6818 

25 

0.5602022594 

0.4331 

1.706906846 

0.6735 

27 

0.5602022594 

0.43325 

1.706906846 

0.67414 

29 

0.5602022594 

0.4332412 

1.706906846 

0.674110 

31 

0.5602022594 

0.433141447 

1.706906846 

0.67411118 

33 

0.5602022594 

0.4332414444 

1.706906846 

0.6741111694 

35 

0.5602022594 

0.4332414444 

1.706906846 

0.6741111695 

37 

0.5602022594 

0.4332414444 

1.706906846 

0.6741111695 

Exact 

0.56020226017 

0.5 

1.706906846 

0.6880216946 
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Singular Integrals 


Singular integrals are defined for unbounded integrands or over unbounded ranges 
of integration. These integrals do not exist as proper or improper Riemann integrals, 
but are defined as limits of certain proper integrals. The Gauss-Christoffel quadrature 
rule is discussed for singular integrals in general, and for those integrals that have 
singularities near and on the real axis. Product integration, endpoint and interior 
singularities and certain methods for acceleration of convergence are presented. Sidi’s 
quadrature rules are studied, and tables are provided for the nodes and weights of the 
Gauss-Christoffel and Sidi’s rules. Hypersingular integrals, specifically the Cauchy 
p.v. and the Hadamard finite-part integrals, are discussed. 


5.1. Quadrature Rules 


We consider I h a 



w(x) f(x) dx. There are four cases of integrals where the 


integrand has a singularity. We will discuss these cases below where the singularity 
occurs at the endpoints of the interval of integration. The Gaussian quadrature method 
does not help in the cases when the singularity is of the form 1 / y/l — x 2 on [0,1], or 
of the form yj 1 — x 2 on [0,1], because of the derivative of the integrand that appears 
in the error term. However, as we have seen, the Gauss-Chebyshev quadrature works 
very well in the case of the singular term 1/y/l — x 2 on [0,1], since it becomes the 
weight function and is removed from the summation as well as the error term E n (see 
§3.2.7). 


Case 1. w(x) = y/l — x 2 on [—1,1]. This is the Jacobi weight function with 


218 
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a = f3 = 1/2. The resulting orthogonal polynomials are the Chebyshev polynomials 
of the second kind U n {x) of degree n. The nodes, weights and error term for this 
quadrature are given by 


l 7T 

Xi = cos-, 2 = 1 ,... , n, 

n +1 ’ ’ ’ 

(5.1.1) 

7r . 2 27T 

w t = - sm -, 

n + 1 n + 1 

(5.1.1a) 

En ~ 2 2n + 1 (2n)\ f 1 < C < !• 

(5.1.1b) 

Case 2. rc(x) = l/\/x on [0,1]. In this case the singularity occurs at one end¬ 
point. The orthogonal polynomials of degree n for this case are p n (x) = P^n 
where P 2 n(%) are the Legendre polynomials of degree 2 n. The nodes for the related 
quadrature are given by 

Xi = a f, i = l,... , n, 

(5.1.2) 

where are the positive zeros of P 2 n(^); the weights are given by 


II 

to 

(5.1.2a) 


where Wi are the weights corresponding to a x in the Gauss-Legendre quadrature of 
order 2n, and the error term is given by 


E n 


2 4n+1 [(2 n)!] 3 (2n) 

(An + 1) [(4n)!] 2 J ’ 


o < c < i. 


(5.1.2b) 


Case 3. w(x) = y/x on [0,1]. The singularity occurs in the derivative of the 
integrand at one endpoint. In this case the orthogonal polynomials of degree n are 

Pn (x) = P‘in+i ( '/x ) , where P‘2n +1 (x ) are the Legendre polynomials of degree 
v T 

2n + 1. The nodes and the weights for the related quadrature are given by 

Xi = af, 2 = 1,... , 2n + 1, (5.1.3) 


w i = 2W i a 2 il (5.1.3a) 

where cu are the positive zeros of P 2 n+i {%) and Wi are the weights corresponding to 
Xi in the Gauss-Legendre quadrature of order 2n + 1, and the error term is given by 


E n — 


2 4n+3 [(2n + l)!] 4 
(4n + 3) (2n)\ [(4 n + 2)!]‘ 


A 2 ”A), o < £ < i. 


(5.1.3b) 


Case 4. w(x) = 


1 — £ 


on [0,1]. The weight function has a singularity at 


one endpoint and its derivative has a singularity at the other endpoint. In this case the 
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orthogonal polynomials of degree n are p n (x) = T 2 n +i {y/x ), where T 2 n +i (%) 

yX 

are the Chebyshev polynomials of the first kind of degree 2n +1. The nodes, weights, 
and the error term for the related quadrature are given by 


Xj = cos 


2 (2 j — 1) 7T 
An+ 2 ’ 


i = 1, ••• ,2n + 1, 


27r 


Wi = 


E n = 


2n + 1 

7T 


2 4 ™+! (2n)! 


/ (2n) (A -i<?<i. 


(5.1.4) 

(5.1.4a) 

(5.1.4b) 


f 


Example 5.1.1. (Ralston and Rabinowitz 1978, p. 112) Compute 7q(/) = 

^ - x 

dx, for n = 2. From (5.1.2), and using the zeros of Legendre polynomials, 


/ x 


we have 


xi = (0.339981) 2 = 0.115587, x 2 = (0.861136) 2 = 0.741555, 

and from (5.1.2a) we get w\ = 1.304290, w 2 = 0.695710. Thus, the approximate 
value of the integral is 

/q(/) « (1.304290)(1.115587) + (0.695710)(1.741555) = 2.666666. 

This result compares very well with the exact value 8/3. ■ 

5.1.1. Gauss-Christoffel Rules. (Gautschi 1968a) Let (a, b) denote a finite 
or infinite interval, and w(x) be a nonnegative weight function defined on (a, b) such 
that J a 6 w(x) dx > 0. We will discuss a sequence of quadrature rules G n (f) 

C b n 

/ w(x)f(x)dx^^X i i n) fU ( l n) Y n = 1,2,..., (5.1.5) 

Ja i =l 

where are called the Christoff el nodes , and the Christoff el weights as¬ 
sociated with the weight function w(x), and each rule is called a Gauss-Christoffel 
quadrature formula ; the rule (5.1.5) is exact for / £ T^n-u The moments fik with 
respect to w(x), defined by /i& = J* x k w(x) dx , k = 0 f 1, 2,..., also exist. If w(x) 
is not of a constant sign, the Gauss-Christoffel formulas still exist if ceratin Hankel 
determinants in the moments are nonzero (see Stroud and Secrest 1966). In this case 
some of the nodes ^ n ^ may lie outside the interval (a, b); in particular, they may 
become complex. 

The procedure to construct the formulas in (5.1.5) is as follows: Construct the 
system {qi(x)} of orthogonal polynomials associated with the weight function w(x), 
and obtain as zeros of q n (x), and A z - n \ in a number of ways, in terms of these 
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orthogonal polynomials. For example, Rutishauser (1963) uses the QD-algorithm, 

(n) 

while Golub and Welsch (1969) use Francis’ QR-transformation to compute Q as 

(n) 

eigenvalues of a Jacobian matrix and A) } as the first components of the corresponding 
eigenvectors. These methods are computationally feasible for large n provided the 
orthogonal polynomials q n (x), or the associated Stieltjes continued fractions, are 
explicitly known. Otherwise, they exhibit a wide range of numerical instability, so 
much so that it becomes impossible to obtain any meaningful results unless multiple- 
precision computation is carried out. 

The ill-conditioned nature of the problem is purely algebraic when one attempts 
to derive ^ n ^ and A- 7 ^ from the 2 n moments of w(x), i.e., solving the algebraic 
system of equations 


S' 


ib) 


$ 


(n) 


i k 


= Hk, & = 0,1,... , 2n — 1. 


(5.1.6) 


For a finite interval, say (0,1), the asymptotic relative condition number tz n for this 
problem is given by 


1 \ 

K n > min (/io, — max 

flQ / 1 <i<n 


n 

i+4 (n) ) n 


i+4 w) i 2 


I A n ) _ A n ) 


}• 


k=l,k^i 

For jjLo = 1, the Table 5.1.1 presents the lower bound of K n , which is estimated by 


1 \ (17 + 6^8) 

K n > min ( no, — -;—o- > min 


in (fjL 0 , — 
V Rn 


1 \ (33.97)" 


64 n 2 V ’ /i 0 / 64 n 2 

Table 5.1.1. Lower bound for Condition Number K n . 


n 

(33.97)"/64n 2 

5 

2.8(+4) 

10 

3.2(+ll) 

15 

6.4(+18) 

20 

1.6(+26) 


Thus, in the presence of round-off errors, the above mentioned rules that rely on 
moments will lose at least 11 decimal digits for n = 10, and 26 digits for n = 20. 
Hence, moments are not suitable for constructing the Gauss-Christoffel formulas. 
However, in §5.3 we will discuss Sidi’s quadrature rules which are obtained after some 
rational approximations by applying a modification of Levin’s nonlinear sequence 
transformation to the moment series of the weight function w{x). 

Computation of Christoffel Weights. TheChristoffel weights A are 
computed by orthogonal polynomials of a discrete variable. Let { q^ } i _ 1 oo denote 
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the associated orthonormal polynomial of degree i such that (qi,qj) = Sij. Let 
be the zeros of q n (x) in increasing order. Then are precisely the Christoffel 
nodes corresponding to the weight function w{x). The Christoffel weights A^ can 
be determined, e.g., from 


A- n) = 


”e [ q k (4 (n) ) 

k =0 L V J 


1 2 


(5.1.7) 


We distinguish two cases: (i) the classical case, in which the orthogonal polynomials 
are known, and the problem is well-conditioned; and (ii) the nonclassical case, in 
which the orthogonal polynomials are not known and have to be generated. The 
first case uses an approximate discretization of orthogonality relation. In the second 
case, modified moments are used, and instead of the monomials 1, x, x 2 ,..., one 
can orthogonalize any set of linearly independent polynomials. Thus, let Qn( 0) = 

N 

w i N ^ > 0, N > n, denote a sequence of auxiliary quadrature 

k =1 V ' 

formulas 

Qn(0) ~ / 4>(x)dx. 

J a 

Let (a, b) = (—1,1). Then define a new inner product (/, g) N = QN(fgw) by 


(f,g) N 


N 

E»r/(4"’ 

k =1 


9 



(5.1.8) 


where w . Since wjf*^ > Ofor k = 1, 2,... , iV, the integrand 

(5.1.8) yields a set of orthogonal polynomials of a discrete variable such 

that (gi, 7 v, Qj.n) N = for i, j = 0,1,... ,1V — 1. Now, define as the zeros 
of q^ N , and let 


A 


(n) 

/. Y 


1 


n— 1 


E 

k =0 


qk,N 



(5.1.9) 


The quantities and A- 7 ^, suitably ordered, are taken as approximations of £ 

and A^, respectively. The following conditions are imposed on the quadrature rules 
Q n : (i) convergence should be reasonably rapid, even in the presence of singularities; 
(ii) the rule Q n should be easy to generate for any, even large, values of N; and (iii) the 
interval [x[ N ^ , x^ , • • •, x spanned by x[ N ^ , x^ , • • •, x should contain the 

required Christoffel nodes ^\x^ , £ 2 ^ ? • • • ? £n^. Thus, N should not be excessively 
large. The process is feasible and avoids storage of a large number of high-order 
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(n) 

quadrature formulas in the computer memory. Since the nodes Q J show a tendency 
to crowd near the endpoints of =bl, we should choose the abscissae x^ to have the 
same property. This rules out the use of most of the common quadrature rules, such as 
trapezoidal, midpoint, and Simpson’s rules. The classical Gaussian quadrature rule 
is in conflict with the condition (ii). Only the N-C formula with the abscissae 


x 


(A) 

k 


= cos 6 


(A) 
k ’ 


c 


2 (fc — 1)7r 
2 N 


(5.1.10) 


which are the zeros of Chebyshev polynomials T n (x), as defined by Fejer formula, 
and the corresponding weights 


w 


(A) 

k 


2 

N 


' \ n l 2 \ COS 

^ m =1 


2 to 6 , {. a A 


4m 2 — 1 


(5.1.11) 


comes close to satisfying all the above three conditions. Note that only one value of 

7T 

cosine, which is cos is needed in (5.1.10) and (5.1.11); the remaining values are 
then generated by well-known recurrence formulas. For best accuracy it is recom¬ 
mended that only the cosines in (5.1.11) be computed recursively, especially when 
N is very large. 

Another suitable quadrature formula is the Gauss-Chebyshev formula defined by 



<p{x) 
Vl — x 2 


dx 


7T 

N 


A 


EH A- 


which is written as 


-1 a 

f <j>(x) (sin e ( k N) ) (j) (4 N) ) , (5.1.12) 

k= 1 

_-1 / o 

which is exact if <p(x) = P 2 A-i(t) (l — x 2 ) , where P 2 A-i(t) G This 

formula is particularly suitable in cases where w(x) has square-root singularities at 
the endpoint ±1. Note that the right side of (5.1.11) is the truncated Fourier series 
expansion of — sin 6^\ which is the weight factor in (5.1.12). 

The process of constructing Christoffel numbers, based on the Fejer formula 
(5.1.10)-(5.1.11) is exact if w(x) is a polynomial of degree m and N > 2n + 
m. Similarly, the process of constructing Christoffel numbers based on the Gauss- 
Chebyshev formula (5.1.12) is exact if w(x) = (l — x 2 ) and N > n. 

Iterative Refinement of Christoffel Numbers. Let be the 

(n) (n) 

approximations to the desired Christoffel numbers Q , A) , which are sufficiently 
accurate when we solve the basic system of algebraic equations (5.1.6) by Newton’s 
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method. Let {pi}^ 0 1 denote a system of 2 n linearly independent polynomials, and 
define the ‘modified moments’ by 

M k = f p k (x)w(x)dx. (5.1.13) 

J a 

The basic system of equations (5.1.6) is then equivalent to 

n 

J2 X i n) P k (cA) = M-k, As = 0,1,... ,2n-l. (5.1.14) 

i=0 

We wish to choose the polynomials p k in such a way that the system (5.1.14), unlike 
(5.1.6), is well conditioned. For this purpose the ideal situation is to require that the 
Jacobian matrix J (Ai,..., A n ; ..., £ n ) of (5.1.14) evaluated at the exact solution 
A i = J^ n \ & = be orthogonal. But instead we consider orthogonality of 
J (A?,..., AO £0). Since 

" Po(Cl) ••• Po(Cn) AlPo (xi\) ■■■ A„p'o(tn) ' 

Pi (Cl) • • • Pi (Cn) AlPi (xii) • • • A n p[ (Cn) 

-Pin —1 (Cl) ' ' ' Pin —1 (C n) VP2n—1 O^l) ' ' ' / VP2ra—1 (Cn) - 

we require that the rows in the above matrix be mutually orthogonal, which implies 
that the inner product {pi,Pj} = 6ij for i, j = 0,1,... , 2n — 1, where this inner 
product is defined by 


n 

{/.!>)=£ [/ (&»(«?) + W ) 2 r («?) s' (& ■ 

Since the modified moments (5.1.13) are not known in advance, they must be gener¬ 
ated along with the polynomials Pi (x) with leading coefficient unity. These polyno¬ 
mials satisfy the recurrence relation 

Pk+i(x) = (x - a k ) p k (x) - (3 k p k -i(x), k> 1, (5.1.15) 

withpo^) = l,pi(a:) = x — «o- If we put 

r b 

h k = w(x) {p k (x)} 2 dx, k = 0,1,..., (5.1.16) 

J a 

then the coefficients of the recurrence relation (5.1.15) are given by 

Pk = -r h ~, As = 1,2. (5.1.17) 

hk-i 

1 f b 

a fe = — / w(x)x{pk(x)} 2 dx, k = 0,1,.... 

hk Ja (5.1.18) 
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If a is finite, then the recurrence relation (5.1.15) can be replaced by the system 


Pk+i (x) = (x- a) q k ( x) - j-p k ( x), 

n k 

q k +i{x) =p k +i{x) - ^^-q k (x), k = 0,1,... 
Ik 


(5.1.19) 


where 


f b 

Ik = w(x) (x - a) {q k (x)} 2 dx, (5.1.20) 

J a 

and { qk (x) } ^ =0 is the set of polynomials with leading coefficient unity and orthogonal 
on (a, b ) with respect to the weight function w(x) (x — a). A similar result holds if 
b is finite. Since (5.1.15) and (5.1.19) are equivalent, we find that 


_ Tfc h k 

OLk — - -1-b CL- 

hk 7/C-1 


(5.1.21) 


The problem of generating the orthogonal polynomials pk ( x ) leads to the determina¬ 
tion of the coefficients of the above recurrence relation, i.e., to compute the quadrature 
rules (5.1.16) and (5.1.18) (or (5.1.20)). 

5.1.2. Logarithmic Weight Function. In order to construct the Gauss¬ 
ian rule for f* x a ( — lnx) dx, a > —1, we must find a computationally suitable 
expression for 

1(g) = f x a (— lux) g(x) dx, (5.1.22) 

Jo 

where g(x) is a polynomial. Since 

I{g) = J dxx a g{x)dx J y = J y J x a g{x) dx 

= [ t a dt [ u a g(ut) du , 

Jo Jo 

then, if {A^ 6}^ is the 7V-point Gaussian rule for f* x a f(x) dx , we get 

N N 

Ls) = EE A AU^) A 1 - 23 ) 

i=l j = l 

for any polynomial g(x) of degree < 2 N — 1. Thus, for any k < IV, 

N N 

^ = EE A AbU^;)} 2 ’ (5-1.24) 

i=l j =1 

N N 

ak = TT ^ ^ } ’ (5.1.25) 

k i =1 3 = 1 
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Similarly from (5.1.5) we get 

1 N N 

Ik = J— K Aj CiCj {Qk (CiCj) } • (5.1.26) 

k i =1 j= 1 

Alternatively, another useful expression for hk and 7 ^ is obtained as follows: Inte¬ 
gration by parts gives 

f (— lux) \x a+1 g(x)]' dx = f x a g(x)dx. 

Jo Jo 

Thus, for all k < N, we have 
N 2 f 1 

N'v{pfete)} 2 = / (-lnx)x“ [(«+ l)p|(x) + 2 a;p' fe (a;)p fe (a;)] dx 

i =1 ^ 

= (2k + a + 1) hk, (5.1.27) 

N 

]T A* ^ { 9fc (e<) } 2 = (2k + a + 2) 7fc . (5.1.28) 

i=l 

For w(x) = ln(l/x), 0 < x < 1, the coefficients a n and f3 n of the recurrence 
relation (5.1.15) are given in Table A. 18, and for w{x) = Ei(x), 0 < x < 00, in 
Table A. 19. The Christoffel nodes ^ and the weights for 10- and 20-point Gauss- 
Christoffel rule (5.1.5) for w(x) = ln(l/x), 0 < x < 1, are given in Table A.20 
and Table A.21, respectively; and those for 10- and 20-point rule in with w(x) = 
Ei(x) = J 0 °° (e~ xt /t) dt are given in Table A.22 and Table A.23, respectively. 

5.1.3. Singular Integrals. We will consider different methods to compute 
singular integrals of the form J ^ f(pc) g(x) dx , where g(x) is analytic and f(x) is 
singular at one or both endpoints, or at an interior point. Let F{x) = f(x) g(x). The 
interval of integration can always be transformed from [a, b\ to [0,1]. For example, 
f(x) = x a (lnx)P is singular at x = 0. If the singularity is at an interior point, then 
the interval [a, b] is subdivided at the singularity and each subinterval is transformed 
to [—1,1] and the two integrals are treated separately. If f{pc) is singular at both 
endpoints, as e.g., f(x) = x~ a (l — x)@, 0 < a, (3 < 1 , or f(x) = In \nx 1 , then 
replace F(x) by \ [F(x/ 2) + F(1 — x/2)\. 

There are basically four approaches to compute singular integrals of the form 
mentioned above. 

1. Ignore the singularity (Rabinowitz’s method). If the singularity is taken out at 
an endpoint, then an open formula does not involve the evaluation of the integrand 
at its singular point. This approach involves a greater quadrature error as compared 
to that for a smooth integral, but it will eventually converge. Patterson’s method and 
open Clenshaw-Curtis formulas (§3.3.1) are feasible for this case. 
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2. In some special cases a Gaussian formula with its requisite weight function 
removes the singularity. For example, for singularities of the following two types, 

_I/O 

we use the quadrature rules as follows: (i) for f(x) = (l — x 2 ) on [—1,1] use 
the Gauss-Chebyshev quadrature; and (ii) for f{pc) = In x on [—1,1] use the Gauss- 
log quadrature. But a situation that arises with such Gaussian formulas concerns 
a nonstandard singularity, which does not have any specific formula. Sometimes 
the method known as ‘removing the singularity’ is used, as is done, e.g., for I = 
Join x (! + x 2 ) dx which can be written as I = f* (In x (1 + x 2 ) — In x) dx + 
Jq 1 In x dx and simplifies to 

I = — f x 2 (l -f x 2 ) dx + f In x dx. 

Jo Jo 

The first integral is nonsingular, but one must be careful with the computer code in 
avoiding the computation of x 2 In x directly, since x 2 In x —> 0 as x —> 0. The 
second integral is obtained analytically. 

3. The method known as ‘creeping up the singularity’ involves evaluating integrals 
whose range of integration approaches the singular point. This method generates a 
sequence of integrals and use of accelerators is needed to predict the required limit 
(see §1.6 on convergence accelerators). 

4. This method uses transformations of the integrand by a suitable change of 
variables, which not only expunges the singularity but also has a zero endpoint de¬ 
rivative for the resulting integrand. The compound trapezoidal rule based on the 
Euler-Maclaurin summation formula (2.2.8) is a useful choice in this case. 

5.1.4. Singularities near and on the Real Axis. Hunter (1992) has 
discussed a method for computing definite integrals 72^ (/) where the integrand has 
singularities near the interval of integration on the real axis. A detailed study is found 
in Bialecki (1989). We consider the following cases. 

1. / is analytic in some region containing the real axis except at the finite number 
of poles of arbitrary order which may be near but not on the real axis. We assume 
that the function / is real, i.e., f(z) = f(z ) for all complex z = x + iy. Although 
this assumption may not be necessary, the function / must satisfy the conditions: (i) 
/ is integrable on the entire real axis; (ii) there is a real number c > 0 such that / is 
analytic over the region D c C C, defined by D c = {z :£ C : |^{z}| < c}, except 
at a finite number of poles of arbitrary order within D c \ and (iii) f(R + iy) —> 0 
uniformly as R —>• =boo for \y\ < c. Then the method consists in the use of the 
following ‘shifted’ form of the trapezoidal rule: 

oo 

T(X,h) = h f((k + X)h), (5.1.29) 

k =—oo 

where h > 0 is a suitable interval and A is a ‘shift’ parameter (0 < A < 1). Then, if 
/ has poles z\,Z 2 ,... G T c such that none of them lies on the real axis, where is 
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of order n m , m = 1,2,..., and if the principal part of the Laurent series of / about 

Tim 

z m is ^2 Pmk (z - z k )~ k , then 
k =1 

I-oo(f) = T*( A, ft) + £(A, ft,c) = T(A, ft) + R{ A, ft,c) + £(A, ft,c), (5.1.30) 
where 



and denotes summation over those poles £ D c which lie above the real axis, 

m 

and the functions Gk are defined by 


Gk (cot a) 


d k 1 ( cot a 

da k ~ x \ (ft — 1)! 


(5.1.33) 


This method allows us to compute 72^o(/) by applying the correction R( A, h, c) to 
the trapezoidal rule T*, with the error term E(\,h,c)(\,h). There are three aspects 
of the rule (5.1.30) that we will consider. 

1 . Choice of c : The quantity c must be chosen large enough so that all poles of 
/ near the real axis, which have significant effect on T(A, h) are contained in D c . As 
c increases, the values of i?(A, ft, c) and E(\,h,c) change only when the horizontal 
edges of D c pass through the poles. This indicates that the value of c must be precise 
as can be seen from the error bound (5.1.32) 


\E(X,h,c)\ < 


g27T C/ h 2. 


ic) I dx. 


(5.1.34) 


which implies that the chosen value of c must be such that the right side of (5.1.34) 
remains minimal. 

2 . Choice of A: The role of the parameter A is to control the effect of round-off 
errors. We must choose A so that R( A, ft, c) has the same sign as T(A, ft) in the case 
of a pair of complex conjugate poles, say z\ and = z \. But in the case when there 
are several pairs of conjugate complex poles it may become difficult to choose a A 
that suits all. In particular, if g is an even function, the value A = 0 or 0.5 should 
normally be used, so that the nodes (ft + 1) ft are symmetrically distributed about the 
real axis. 
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3. Computation of G&(cota):In view of the definition (5.1.33), we have 
G\ (cot a) = cot a , G 2 (cot a) = — esc 2 a , and so on. But we will use the recurrence 
relations: 

(2m - l)G 2m (cota) = - [G m (cot a )] 2 

m—1 

— 2 > G,-(cota) • Gofe-i(cota), m > 2, 

“ (5.1.35) 

m 

2 mG 2 m +i(cot a) = — 2^Gj(cota) • G 2 fe-j+i(cot a), m > 1. 
j=i 


Example 5.1.2. The integrand f(z) = 

function and has conjugate poles of order 3 at zi 
of the principal part of the Laurent series are 


-o, a > 0 real, an even 

(.z 2 + a 2 ) 3 

= ia and ^2 = —ia. The coefficients 


P n = 


— ie a2 (3 — 4a 2 + 4a 4 ) 


16a 5 

The error from (5.1.34) is 


P 12 — 


TUMI < 


g27T cj h _ 


i£ 


— e a2 (3 — 4a 2 ) 
16a 4 


e -(x+ic) 2 


[(t + ic ) 2 + a 2 ] 


7 Pl3 — 






8a 3 ' 


2y^ire c , 2 2 \ 3 , 

^ e 2«c/h _ i ( c " a ) providedc > 


Since the maximum value of the expression on the right occurs when c is close to 
7r/2, we get 


( 7T 2 \ 3 / 7f 2 \ / 7f 2 \ 3 

— - a 2 J csch ^ — J - a 2 J provided a < 7r/2. 

Note that the integrand satisfies the criterion in (ii), which implies that we can take 
A = 0.5. Then,fora = 0.01 and ft = 0.5, we find that |E(A, ft, c)| < 4.1235 x 10“ 22 . 
The following results are obtained: 

For A = 0: T(0,0.5) = 0.5 x 10 12 ; #(0.0.5, c) = -0.48812942 x 10 12 ; thus, 
T*(0,0.5,c) = 1.17805786 x 10 10 . 

For A = 0.5: T(0.5,0.5) = 3832.681561; #(0.5,0.5, c) = 1.1780376 x 10 10 ; 
thus, T*(0.5,0.5, c) = 1.17805789 x 10 10 . ■ 

5.1.5. Branch Singularities. The technique discussed above can be ex¬ 
tended to deal with branch singularities. Consider a special case when f(z) = 
(z 2 + a 2 ) a g(z), where a > 0 and a are real, a > — 1 and a not an integer, and g is 
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analytic inside a strip containing the real axis. As in (5.1.29)—(5.1.32), we integrate 
7r (z 2 + a 2 ) a g(z) cot ir(z/h — A) around a suitable contour which is the rectangle 
with vertices at ±R ± ic. But if c > a, we must make slits in it to avoid the branch 
points at =b ia. Eq (5.1.30) still holds, but now the correction term becomes 


72(A, h, c) = 2 sin(mr) f (t 2 — a 2 ) c 

J a 


g(it) 


g(-it) 


a + ce 


which can be evaluated by setting t = 0 

1 + e lu 

into (— 00 , 00 ), and then use the trapezoidal rule. 


g2i:(t/h-\-iX) 2. ' g 2t:( t/h—i\ ) 2 J 

(5.1.36) 

, so as to transform the interval [a, c] 


,2 u 


/ 2 — 1/2 

e~ x (x 2 + a 2 ) dx which has the exact 

-oo 

value e a ! 2 Ko(a 2 /2 ), where Kq is the modified Bessel function of the second kind. 
For small a the branch points at =b ia are not easy to resolve. Foe example, for 
a = 0.1 we get T(0.5,0.5) = 4.43878372; then, after using the trapezoidal rule 
with the interval k = 0.25, the correction (5.1.36) is i?(0.5, 0.5, 2ir) = 1.0026444; 
thus, T*(0.5,0.5, 2 t r) = 5.44142820; the exact value is 5.441428207737099, which 
is correct to 8 decimal places. ■ 


The method is deficient in (i) the restriction a > — 1; and (ii) the computation of 
R( A, ft, c) which may involve a large number of function evaluations; there are 85 
function evaluations for computing R( A, ft, c) in Example 5.1.3. But if we do not 
use this method and use only the trapezoidal rule to compute T(0.5, h), without the 
correction factor 72(0.5, ft, c), we would require over 200 function evaluations with a 
value of h < 0.02. 


5.1.6. Gautschi’s Computation Codes. Gautschi (1994) has provided a 
collection of subroutines ORTHPOL and examples together with the underlying nu¬ 
merical methods which describe the procedures to generate orthogonal polynomials 
relative to arbitrary weight functions. The computer routines are useful in producing 
the coefficients of the three-term recurrence relation of the type (3.4.8) satisfied by 
the orthogonal polynomials. Once the coefficients are known, it is easy to generate 
additional data such as the zeros of orthogonal polynomials and Gaussian-type quad¬ 
rature rules. Computer routines are provided for some of the well-known Gaussian 
rules, like Gauss-Radau and Gauss-Lobatto rules, discussed in §3.3. 

5.1.7. Rational Gaussian Formulas. Gautschi (1999) has developed an 
algorithm GQRA that provides Gaussian quadratures that are exact for combinations 
of polynomials and rational functions, which are selected so as to simulate poles that 
may be presents in the integrands. The rational Gauss formula is of the form 

A k f(xk) + Rn(f), (5.1.37) 

M 

Let U0m(t) = El (l + Ci*)‘ J be a polynomial of exact degree m. Assume that the 
3 = 1 


n. n 

/ f(t) d\(t) = 

Jr fc =i 
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measure dX/uJm admits an n -point Gaussian quadrature rule of the form 

[ P(t) = J2 w kP (£k) - P e ^2n-i, (5.1.38) 

Jr v m (t) J 

where the Christoffel nodes are contained in the support of dX. Define ^, 

A/,. = w^f oj, n (£|?) ■ Then we obtain the formula 

A k9(Zk) + Rn(9), (5-1.39) 


P n 

/ 9(t)dX(t) = ^2 

Jr k =i 


where R n (g ) = 0 for all g € Conversely, if (5.1.39) holds with G 

supp(dA), then so does (5.1.38) with and as defined above. The nodes for 
the rational Gauss formula are the Christoffel numbers (or nodes). Gautschi (1999) 
discusses the following examples. 


Example 5.1.4. h{w) = 


r~ 

J -1 si 


( 7 xt/w) 


/_! sin(7 xt/w) 
real poles at the integral multiples of w. ■ 

4 f- 1 / 2 r(t + i) 


dt,w > 1. The integrand has simple 


Example 5.1.5. / 2 (w) = / 

7o 


t + w 


dt , w > 0. Here dA(£) = 


t x ! 2 dt, and the integrand has poles at — re and at negative natural numbers. 


Example 5.1.6. Generalized Fermi-Dirac integral 


F k 




e-ri+i + 1 


dt, 


17 R, 6 > 0 . 


The values of k of physical interest are A: = \, |, |. The following results are 
noteworthy: For k = 77 = 1 and n = 5, the integral has value 0.2905125 with a 

relative error of 0.39(—05). For this integral, also see Gautschi (1993), Lether (2000, 
2001), and MacLeod (1998). - 

Example 5.1.7. Generalized Bose-Einstein integral 


G k 




e-v+t - 1 


dt, 


rj < 0 , 6 > 0 , 


has poles that complex conjugate on the axis } = 77 , at a distance of multiples of 
27r from the real axis. Some results are as follows: 

For rj = x = —0.001, 6 = 10 -4 , k = 

n = 6 , m = 11 , the integral has value 0.2217149(4-01) with a relative error of 
0.2728(—06); 
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n = 6, m = 5, the integral has value 0.2217150(+01) with a relative error of 
0.1653(-06); 

n = 6, m = 1, the integral has value 0.2217150(+01) with a relative error of 
0.1573(—06). ■ 

Example 5.1.8. Radiation transfer integral 

H m (c) =2 f P m (x) [sin(27nr)] 2 e~ c ! x dx, c > 0, 

Jo 

where P m (x) is the Legendre polynomial. It is found that 

f 0.29351229600590(—07) forn = 26, 

50( ’ ~ \ 0.29351229563622(—07) for n = 27. ■ 


5.2. Product Integration 

Rabinowitz and Smith (1992) study the product rules for 7i 1 (fc/) based on Gauss- 
Jacobi, Gauss-Radau and Gauss-Lobatto rules with the Jacobi weight function w (x) = 
(1— x) a (l-\-x)P, a, (3 > — 1, as applied to singular integrals, and determine sufficient 
conditions for convergence of these rules for both endpoint and interior singularities. 
Let {xi n } denote the nodes, and let w(pc) £ R[— 1,1]. In the case of L 2 theory, 
there are no restrictions on w, but in the case of the L p theory the weight function is 
restricted to the generalized smooth Jacobi (GSJ) weight function of the form 

N 

w(x) =i){x) P[ \x-t k \ lk , 7fe >-1, .ZV>0 . , 

k =0 \ ' ' ) 

— 1 < to < ti < . . . < tiv+1 = 1? 


where ^ £ C[— 1,1], ^ > 0, and t) denotes the modulus of continuity of the 
function The L 2 theory of product integration requires that both / and K = k/w 
must belong to L 2 , w . This theory is studied in detail for the Gauss-Jacobi nodes in 
Lubinsky and Sidi (1986), and extended to the Gauss-Radau and Gauss-Labatto nodes 
in Rabinowitz and Smith (1992). On the other hand, the L p theory is based on the work 
of Nevai (1984) on weighted mean convergence of Lagrangian interpolation, where 
it is proved that product integration rules applied to bounded Riemann-integrable 
functions / converge under certain conditions on w and k £ L\ [— 1,1]. 

For singular integrals, let the function / be unbounded at a finite set of nodes 
Y = {?/j, j = 1,...,/} C [—1,1], and we set / (yj) = 0. In the L 2 case we can 
generally ignore the singularities, whereas in the L p case the singularities can be 
generally avoided except in the case of the Jacobi weight function where they can be 
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ignored only in certain situations as noted in Rabinowitz (1987) and Vertesi (1989). 
Let 


n+s 

In = ^ ^ Win f {%in) ? L S £= {0? 1}? 

2=1 —r 

1 = xq u <C X\ n T nn <C T n _|_i ?n = 1, (5.2.2) 

where the weights Wi n (k) are chosen such that I n (kf) = I(kf ), and the rule is 
exact if / is a polynomial of degree < (n + r + s — 1). The nodes {x in } are 
taken as the Gauss-Jacobi, Gauss-Radau and Gauss-Labatto points with respect to 
some w £ GSJ; i.e., they are the zeros of g r+s+n (x; w) = w rs (x) p n (x; w), where 
w(x) = w sr (x)w(x), and for any v £ GSJ we have {p n (x\v) = k n (v)x n + 
••• + £+(+) > 0; n = 1 , 1 , 2, ... } as a sequence of orthonormal polynomials with 
respect to the inner product (f,g) = I(vfg). If we denote the zeros of p n {pc\v) 
by Xi n (v), i = 1,... , n, and the corresponding Gauss weights by Pi n (v) so that 

n 

I{vg) = Y, ftn(w) g ( X in {v )) + E n g, with E n (g) = 0 if g <E V 2 n -i, we write the 

Gauss-Jacobi, Gauss-Radau and Gauss-Labatto rules with respect to w in a uniform 
manner as 

n+s 

I(wg) = 'y ^ fii n g (xi n ) -j- E n g , (5.2.3) 


where fi in = /jL in (w)/w sr (x in ) > 0,i = 1,... and E n g = 0 if ^ £ V 2 n+r+s-i- 
If g e C 2n+r+s [-1,1], then 


Hn9 — 


(-1) S 


g(2n+r+s)^ 

(2 n + r + 5 )! 


A+O) 2 , 


1 < £ < 1. 


(5.2.4) 


In the Gauss-Jacobi case, r + 5 = 0, w = w, j2i n = Pi n (w), and = £i n (rc); in 
the Gauss-Radau case, r + 5 = 1; and in the Gauss-Labatto case r + 5 = 2. The 
weights are po n > 0 and o( 1) as n —> 00 when r = 1, and Jl n +i,n > 0 and o(l) 
as n —> 00 when 5 = 1. The nodes = cos 6i n , 0 < 6i n < 7r, which implies 

that 6i n — 6i+ i ?n ~ n _1 uniformly for 0 < i < n, n = 1,2,-Let J = [—1,1] 

and T = {tj, j = 0,1,... , TV + 1}. Then the weights /+ n in any closed subinterval 
J — T are such that /+ n ~ n -1 . The Lagrangian interpolation polynomials L n for / 
at the zeros of p n (x\w) are defined by 


n 

L n (x ; wJ) = Y, hn{x', w) f (x in (v)), 


l in (x;w) 


_ Pn(x;w) _ 

(x - x in (w)) p' n (x in (w); w) ’ 


or 


lin(x]w) 


k n -l(w) 
kn (w) 


Pin(w)p „-1 (x in (w)-,w) 


Pn{x;w) 

X - X in {w) 


(5.2.5) 
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The Lagrangian polynomials that interpolate / at the zeros of g n+r+s (x\w) are given 
by 

n+s 

Ln (t; w \/) = 'y ^ kn(x;w) f (x in ), (5.2.6) 

2=1 —r 

for certain polynomials k n (w) £ P n+r+s _i such that E) = For i = 

1,... ,n, we have 

Li(z; «0 = Wrs ^\ l in ( x; w )). (5.2.7) 

^sr (Tin ) 

Since I n (f\k) = I ( kL n (w\f )), we have w in (k) = I ( kl in (w )). 

5.2.1. Endpoint Singularities. (Y = 0) Rabinowitz and Smith (1992) 
have proved the following five theorem. 

Theorem 1. Let / £ C[— 1,1], w £ GSJ, and g = w c df, where c, d are 
arbitrary but not necessarily such that c, d > —1. Let v* = w \_ c j ? -Then 

J k(x) [g(x) — L n (x] w; g)} dx —> 0 as n oo, (5.2.8) 

if (i) k £ Li[—1,1]; (ii) fcr* £ L log + L[—1,1]; (iii) k w~ x ! 2 (l — x 2 ) 1//4 £ 
Li[—1,1]; and (iv) v* w 1//2 (l — x 2 ) 1//4 £ Li[—1,1], where we have used the no¬ 
tation h £ L log + L[— 1,1] which means that I (|/i(log |fo|)|) < oo. This theorem 
is applicable only to the Gaussian rules for functions g £ C[— 1,1]. The strongest 
results occur when c and d are negative integers. 

Example 5.2.1. Consider w{x) = (l — x 2 ) 7 , and / = 1. The nodes 

{xi n (w)} are the zeros of T n (x). If g(x) = (l — x 2 ) m so that v* = g , the 
condition (ii) demands that k(x) (l — x 2 ) m £ L log + L[— 1,1], i.e., k behave like 

(l — x 2 ) m 1+£ . Then conditions (i) and (iii) will be satisfied, but (iv) can hold only 
if m = 0. Thus, the above result is not applicable to the case of Chebyshev nodes, 
when there are endpoint singularities. ■ 

Example 5.2.2. w(x) = 1, and / = 1. The nodes {x in (w)} are the Gauss- 
Legendre points. If g(x) = v*(x) = (l — x 2 ) \ the condition (iv) is satisfied. If 
k(x) (l — x 2 ) X £ L log + L[— 1,1], then all remaining conditions are satisfied; thus 
k must behave like (l — x 2 ) £ near the endpoints so that kg £ L\ [—1,1]. ■ 

i /p 

Example 5.2.3. w(x) = (l — x 2 ) ,and / = 1. Then the nodes {xi n } are 

the zeros of U n (x). If g(x) = v*(x) = (l — x 2 ) m , then the condition (iv) implies 
that m must be < 1. If we take m = 1, we are back to Example 5.2.2. ■ 

Example 5.2.4. w(x) = (l — t 2 ) 3//2 , and / = 1. The nodes {x in (w)} are 
the zeros of the Jacobi polynomial P 3//2,3//2 (x). If g(x) = v*(x) = (l — x 2 ) ™ 
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condition (iv) demands that m < 2. For m = 2, condition (ii) requires that 
k(x) (l — x 2 ) 2 £ L log + L[— 1,1], so that k behaves like (l — x 2 ) 1+£ near the 
endpoints. With this choice of k the conditions (i) and (ii) are satisfied, so that the 
PIR converges for the strongly singular function (l — x 2 ) . ■ 

In L p theory, let w £ GSJ. and let K = k/w £ L q ^ w [— 1,1], where q is such that 


(C0 + 1) (I4)| <mi »{J,£ 1 ±i}, 
( 0„ +1 +1) (I - i)| < mi „{I, 




1 Cfc + 1 ' 


k = 1,.. 


, TV. 


Theorem 2. If |/| p is monotone integrable with respect to w and p, where 
p _1 + g -1 = 1, and if we set /(=bl) = 0, then I n {f\ k ) —> 7(fc/) as n —> oo. 

Theorem 3. Let rc £ GSJ be such that v = w/w sr £ GSJ, and assume that 
K = fc/w £ Lq^, where p _1 + g _1 = 1. If |rc sr /| p is monotone integrable with 
respect to v, then I (k L n (w ; /)) —> 7(fc/) as n —> oo. 

Example 5.2.5. If w(x) = (l — x 2 ) , then q takes any value in (1, oo). For 

/ to be as singular as possible, we must choose p close to 1. Then, if / = (l — x 2 )^, 
f3 > — so that \f\ p is monotone integrable with respect to w, we determine the 
appropriate value of p, and the corresponding value of q would place the restriction 
on k that kf be in L 1 [—1,1]. Thus, if k = (l — x 2 ) 7 , then /? + 7 > —1, and all four 
conditions of Theorem 1 are satisfied; thus, the PIR based on the Chebyshev nodes 
converges for all / with (3 > —1/2, but Theorem 3 is not applicable since w/w sr 
GSJ. - 

Example 5.2.6. If w(x) = 1, then 1 < q < 4, which gives p > 4/3. If 
/ = (l — x 2 )^, then (3 must be > —3/4. Using Theorem 2, the PIR based on Gauss- 
Legendre nodes converges only if / has a singularity weaker than (l — x 2 ) 3//4 . 

But since the condition on k is weaker than (l — x 2 ) 3//4 , we can allow a strong 
singularity on k\ for this we need kf £ L\[— 1,1] as in Example 5.2.5. Theorem 3 
does not apply in this case. ■ 

Example 5.2.7. If w(x) = (1 — x) 1//2 , then 1 < q < 3, which gives p > 3/2 
and (3 > — 1. This case has good convergence. If we apply Theorem 3, we get a 
stronger result that permits us to take (3 > — 4/3. ■ 

Example 5.2.8. If w(x) = (1 — x) 3//2 , then 1 < q < 5/2 so that p > 2/3 and 
f3 > —3/2. As in Example 5.2.6, this does not give as good a result as in Theorem 
1. However, Theorem 3 weakens the condition on (3 , but it is not as good as (3 > —2 
used in Examples 5.2.1-5.2.4. ■ 

5.2.2. Interior Singularities. Assuming that / has unbounded singularities 
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at the set Y = {yj , j = 1,... , /} c [—1,1], we define / (yi) = 0. Besides these 
singularities, there may be additional singularities at the endpoints ± 1 . 

Theorem 4. Let w £ GSJ, and K/k/w £ L qtW [— 1,1], where p _1 + g -1 = 1. 
If |/| p is monotone integrable with respect to w and Y for some p > 1, then 

In(f',k)= ^2 w in(k) f (x in ) -> I(kf) as n —> oo, (5.2.9) 

ier(n,f ) 


where r(n, /) denotes a subset of { 1 , 2 ,... , n} such that i £ r(n, /) if either T n 
Xi + i, n ) = 0 or if for any j , 1 < j < l, such that ^ we 


have 


rvj 

J Xo.n. 


> iij n . If Y = 0, which means that there are only endpoint 


singularities, we have r(n, /) = { 1 , 2 ,... , n}. 

Theorem 5. Letic £ GSJ be such that v = w/w sr £GSJ,andiL £ L qjV [—l, 1], 
where p~ x + q~ x = 1. If \w sr f\ p is monotone integrable with respect to v, we have 


(kL n (wJ)) ^ I(kf) as n -s- oo, 


(5.2.10) 


where L n (w; f) = J2 hn(x',w) f (x in (w)). 

For the sake of simplicity, we will assume that / has a single singularity at a 
point £ £ (—1,1), £ tk, k = 1,... , N. Let M^(£, fc) denote the class of all 
functions g such that g £ C(£, 1 ] and there exists an F > 0 on [— 1 , 1 ] such that 
F = 0 on [—1,1], F is continuous and nondecreasing on (£, 1], |/| < Lon [—1,1], 
and kF £ L\[— 1,1]. Then, if w £ GSJ, and / £ M^(£, fc), fc(£) ^ 0, and for some 

p > 1 

f k £ Tp[— 1 , 1 ], 

l fcw’ s -l/4,r-l/4Wr 1/2 G L p [-l,l], 

and k is either continuous or of bounded variation or satisfies a Lipschitz-Dini 
condition in lN/^(£) = [£,£ + £], where <5 is such that lN/^(£) fl T = 0, we have 
7 n (/, fc) = I n (f ) — / 0 r Kn ) —> 7(fc/) as n —> oo, where 6 : is an index such that 

Tk— l,n ^ £ ^ T Kn . 


If w is the Jacobi weight function, then we can ignore the singularity in certain 
cases (see Rabinowitz 1987, Vertesi 1989). 


Example 5.2.9. w(x) = (l — x 2 ) a , f(x) = (l — x 2 )^,and k(x) = (l — x 2 ) 7 
with /? + 7 > — 1 . In 1/2 theory, if / £ and £ Z/ 2 jiy , then, in view of Theorem 
2, we must have (3 > — (a + l)/2 and 7 > (a — l)/2. But in L p theory, we must 
have / £ L PiW and K £ L PiW , where we take q £ (—1, 00 ) when a < — 1 / 2 , and 


2 - 

P> 


2 tr T 3 
2tr T 3 


< q < 2 + 


and 7 > 


-when a > —1/2. Then 8 and 7 must be such that 

2a +1 ' ; 

cy 1 

— — -. This permits us to deal with a singularity stronger 
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than —1/4. But in view of Theorem 3, a is restricted to a > 0. Then in L 2 theory, 
(3 and 7 must be such that (3 > — (<r -b 2)/2 and 7 > a/ 2, whereas in L p theory 

Ot Ot Ot Ot 

we must have (3 > ---- and 7 >-b ---, which is only a minor 

H 2 4a + 4 ; 2 4a+ 4 J 

improvement. ■ 


5.3. Acceleration Methods 


5.3.1. Endpoint Singularity. Consider the sequence {S n } defined by 

S n = f* F(x) dx. Then S n S as n —> 00 only if x n —» 0 as n —> 00. The 

n 

successive terms of this sequence are generated by S n = ^ where 

i=1 


Ti = 


f 

J x % 


F{x) dx , i > 1 


(5.3.1) 


with xo = 1 and x n —> 0 as n 00 . Amongst various choices of x n , the most 
effective choice is x n = 6 n , 0 < 6 < 1. The terms in (5.3.1) are computed by the 
Patterson quadrature formulas of order 3, 7, 15, 31 ... (see Chapter 4). This method 
has high accuracy since the 7V-point Patterson formula is exact for a polynomial of 
degree < (3 N + l)/2. Also, the Patterson formulas are progressive in computation 
since they use the previous values as N increases. 

Example 5.3.1. Consider a simple singular integral: x~ a dx , a < 1, for 

which T n = 7 _ 1 6 ) ( n_1 ) 7 (1 — 6 )7 ), 7 = 1 — a. Thus, the ratio ^ ' n = # 7 , which 

T n ~ 1 

is independent of n. Hence, the series for S n has pure geometric convergence, and 
Aitkin’s A 2 process (§ 1.6) will ensure convergence to the correct limit value from only 
the first three terms S\, S 2 , S 3 of the sequence {S n } for any value of 6 , 0 < 6 < 1. ■ 


In the general case, Shanks’ diagonal transformation (Shanks 1955), as imple¬ 
mented by the ^-algorithm, is useful for computing integrals of the form f* x~ a g(x) dx. 
For such integrals, we have 


T n 
T n -1 


0 1 9 (fin) 

9 (£,n- 1) ’ 


0 U <in 


(5.3.2) 


which does not exhibit pure geometric convergence. But the singularity at x = 0 is 

approached in the limit and we have lim ^ = 1 , which yields lim = 

n^oo g (f n _i) n^oo T n _ i 

6 )7 , and the ratio (5.3.2) exhibits almost pure geometric convergence for moderately 
large n or small 6. 

5.3.2. Logarithmic Singularity. The integrals are of the form Inx g(x) dx. 

For f{pc) = In x, we find that 


T n =f Hu) 0 "- 1 [n{ 1 - 9 ) In 6» + 6 - 1 - In0]. 


2005 by Chapman & Hall/CRC Press 











238 


5. SINGULAR INTEGRALS 


Thus, 

Tn = 0(n-T)g(t„) = 6>-l-lng 

T n -i (n-l-^g^Y T (0-l)ln0‘ 

Since lim r( 6 ) = 1/2 and lim r{ 6 ) = 1, the function r( 6 ) increases monotonically 

from 1/2 to 1. The method again exhibits rapid geometric convergence for moderately 
large n or small 6 . Hence, the ^-algorithm will provide rapid acceleration as in the 
case of endpoint singularity. 

From these two cases it is obvious that the Patterson quadrature formulas together 
with the ^-algorithm are mostly effective for computing singular integrals. The pa¬ 
rameter 6 in x n = 6 n plays an important role in the sense that large values of 6 (close 
to 1) produce narrow intervals of integration, which require a minimum number of 
nodes for implementation of the quadrature formulas, and convergence in this case 
becomes very slow; on the other hand, small values of 6 produce rapid convergence 
but computation process takes more time since x n —> 0 (which is the singular point) 
slowly. From a practical point of view, one must refrain from approaching a dis¬ 
tance of 10 ~ p of the singularity, where p is the machine precision of the computer 
used. Thus, the relation 6 n = 10~ p provides a ceiling on the value of n, which 
is n = —p/(log 6 ). However, for safe computation, we should stay two orders of 
magnitude away from the singularity, which suggests the maximum value of n as 
(2 — p)/ (log 0 ). 

Example 5.3.2. Evans, Hyslop and Morgan (1983) investigated the optimum 
choice of 6 by computing many test integrals, some of which are: 

h = fo dx = 10 6 , a = 1 — 10 -6 ; 

I 2 = fo x 0 - 95 e x dx « 1.020457365236762; 
h = f*(lnx ) 2 (l+x 2 ) -1 dx k 1.937892292518698; 

I 4 = p ^fx e~ x (1 + x)~ l dx ss 0.2560043390094941. 

It is found that the classical Romberg halving choice of 6 = 1/2 was too large in 
many cases since it required a large number of terms (~ 20) for the ^-algorithm to 
achieve the desired accuracy. The smaller value 6 = 0.1 produced rapid convergence 
of the accelerated sequences {S^}, but it also created computational problems due 
to the rapid approach to the singularity. Finally, the value 9 = 0.2 was assumed 
reasonable for all the above test integrals. Notice that the integral I\ exhibits pure 
geometric convergence; the ratio T n /T n _i « 1 + 10 -6 In 6 ~ 1, and therefore, an 
accurate value of T| can be obtained by using 7- or 15-points Patterson quadrature 
formula. The integral I 2 , first studied by Cohen (1980), presented some computational 
problems when the Romberg halving technique was used; the integrals Is and I 4 
have common singularities. According to Evans et al. (1983) the number of function 
evaluations (denoted by Nf ) required to achieve a tolerance (relative error) of E = 
10 -10 (denoted by [*]) for different choices of 6 is shown in Table 5.3.2. ■ 
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Table 5.3.2. 



0 = 0.1 [Error] 

9 = 0.2 [Error] 

6 = 0.5 [Error] 

h 

45 [4.3(—6)] 

21 [4.4(—6)] 

21 [2.3(—6)] 

h 

32 [*] 

27 [*] 

40 [*] 

h 

102 [*] 

111 [*] 

91 M 

h 

105 [*] 

127 [*] 

184 [*] 


Example 5.3.3. The test integrals used by Chisholm, Genz and Rowlands 
(1972) are: 

Ji = / 0 27r Inx sin xdx « -2.437653392946959; 

J 2 = fo x 3 / 2 dx = 0.4; 

J 3 = fg x 1 / 2 In xdx = —4/9; 

J 4 = f x x 1 / 4 cos xdx « 0.4451649230350326; 

J 5 = fo x~ 1/2 ,dx = 2; 

J 6 = f x (x 1 / 2 + a; 1 / 3 ) da; « 0.841116918071282; 

J 7 = Jg 1 ln(l — cos a;) da; ss —2.721065445; 

Jg = x~ x ! 2 In x dx = —4; 

Jq = ff° ue~ u (l + u 2 ) du = fo t (l + t 2 ) 1 da; 

« 0.3433779615645852; f 

J 10 = e -“ (1 + m ) _1 du = Jg (1 +1 )“ 1/2 da; « 0.7578721561656181; f 

J 11 = / 0 °° e _ “ at 7 / 2 du = f^ t 1 ' 2 dx « 11.63172839718821; f 

J 12 = / 0 °° e _ “ (1 + u ) _1 u~ x ! 2 du = f^ t~ 1/,2 ( 1 +1 ) -1 / 2 da; 

' ' « 1.343293414929015; f 

f In these integrals t = — In x. 

Chisholm et al. (1972) used the trapezoidal rule and a 2-point Gauss-Legendre 
rule with uniform partition into 2 P subintervals (p = 0,1,2,...), whereas Evans et 
al. (1983) used their own algorithm discussed above with a 2(p + 4)-point Gauss- 
Legendre sequence with arithmetic increase in the number of nodes, and a p-point 
Gauss-Legendre rule for the semi-infinite range with 0 = 0.2 and E = 10 -10 . 
A comparison for the relative error E and the number of function evaluations Nf 
between these two methods is presented in Table 5.3.3. ■ 

Example 5.3.4. Test function used by Harris and Evans (1977) and by Squire 
(1979) are: 

Hi = fo y/x dx = 1/3; 

Hi = fo x~ x ! 3 dx = 3/2; 


2005 by Chapman & Hall/CRC Press 





240 


5. SINGULAR INTEGRALS 


Hs = fo x ~ 2 / 3 dx = 3; 

H 4 = fo x 7 / 2 dx = 2/9; 

Hb = Jq(Ihx) 2 dx = 2; 

Hq = JqQux ) 4 dx = 24; 

H 7 = fo( 1 + ^ 2 ) _1 dx = ir/4 ; 

i ^8 = Jq x ~ 1//2 lnxdx = —4; 

= /o(l -ln^-^-lnx)- 1 / 2 dx « 1.34329342585706. 

The results based on the three methods (Harris and Evans 1977, Squire 1979, and 
Evans et al. 1983 with 6 = 0.2) are compared in Table 5.3.4. ■ 

Example 5.3.5. Some test integrals with singularities at both endpoints are: 

B\ = Jq x - 1 / 2 (1 — x) -1 / 2 dx = 7 r; 

B 2 = fo x ~ 1/2 lnln x~ x dx =« 0.2318630313168279; 

B 3 = £(1 - x )~ 2 lnlnx - 1 dx « -0.06281647980603772; 

# 4 = Jq(— lnx) _1 (— lnx ) -1 dx « 1.34329342585706; 

# 5 = Jq 1 lnx ln(l -x)dx^ 0.3550659331472245; 

= /o(l - t )- 1 lnxdx « -1.644934066788805. 

The results based on the three methods (Harris and Evans 1977, Squire 1979, and 
Evans et al. 1983 with 0 = 0.2) are compared in Table 5.3.5. ■ 

Thus, we can easily conclude that the combined e-Patterson procedure (Wynn 
1956; Patterson 1968) seems to be very effective for a large number of singular 
integrals. 

5.3.3. Levin’s Transformations. (Sidi 1979b) Let {A n }^ 1 be a sequence 
which converges to A as n —> 00 . Let Tk, n denote the approximation to A , and 7 
i = 0 , 1 , 2 ,... , k — 1 , be the solution to the (k + 1 ) linear equations 


fc-i 


A solution of these equations is given by 



(5.3.3) 


E(-i ) j C;)A n+j /R n+j 
3= 0 


(5.3.4) 


E( TO ( n + j) k ~ r /Rn+j 

3=0 

A /c (n /c ~ 1 A n /R n ) 

A k {n k ~ 1 /R n ) 


(5.3.5) 
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Table 5.3.3. 



Chisholm et al. (1972) 
N f [E\ 

Evans et al. (1983) 

N f [E] 

Jl 

60 

[1.1(—5)] 

57 

[1.0(-10)] 

J2 

62 

[1.0(—8)] 

29 

[1.0(-10>] 

J 3 

65 

[6.2(—7)] 

59 

[1.0(-10)] 

Ji 

65 

[1.0(—8)] 

51 

[1.0(-10)] 

Jb 

62 

[9.1(—7)] 

45 

[1.0(-10>] 

Je 

62 

[1.9(—8)] 

49 

[6.7(—7)] 

Jr 

65 

[1.0(—8)] 

65 

[8.2(—9)] 

Js 

65 

[2.5(—3)] 

59 

[4.0(—7)] 

J9 

65 

[5.1(—6)] 

59 

[3.3(—9)] 

Jio 

55 

[2.7(—6)] 

47 

[1.2(—8)] 

Jll 

55 

[5.2(—7)] 

59 

[1.9(—6)] 

J\2 

65 

[2.3(—5)] 

55 

[3.2(—6)] 


Table 5.3.4. 


Harris and Evans (1977) 

Squire (1979) 

Evans et al. (1983) 


E (N f = 20) 

E (N f = 35) 

E (Nf = 35) 


3.5(—6) 

1.7(—6) 

2.2(—8) 

h 2 

2.3(—4) 

3-l(—6) 

2.4(—7) 

h 3 

1.2(—2) 

1.9(—3) 

l.l(-6) 

Hi 

1.0(-10) 

2.0(—5) 

1.0(-10) 

h 5 

4.6(—4) 

1.6(-6) 

9.5(—4) 

He 

1.0(—2) 

6.3(—5) 

9.8(—2) 

h 7 

1.0(-10) 

3.8(—6) 

1.0(-10) 

Hg 

5.5(—3) 

8.3(—4) 

1.8(-6) 

h 9 

1.5(—6) 

8.4(—5) 

1.3(-5) 


Table 5.3.5. 


Harris and Evans (1977) 

Squire (1979) 

Evans et al. (1983) 


E (Nf = 20) 

E (N f = 35) 

E (Nf = 35) 

Hi 

7.5(—7) 

7.1(—5) 

6.4(—7) 

b 2 

6.7(—3) 

1.5(—3) 

6.2(—3) 

b 3 

1.3(-4) 

l.l(-5) 

2.8(—4) 

Bi 

1.5(—6) 

8.4(-5) 

1.3(—5) 

B 5 

3.3(—6) 

4.0(-6) 

1.7(-8) 

Be 

3.6(—7) 

2.0(—7) 

1.7(-5) 
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where A k a n = J2(—l) k J ( k ) ctn+j- Let a\ = A ly and a r = Ai r _i, r > 2. 

3=0 

Some special cases are: 

For the G transformation: Take R r = a r \ 

For ^-transformation: Take R r = r a r \ and 

For ^-transformation: Take R r = a r a r +\j (a r+ i — a r ). 

The t- and ^-transformations deal with alternating and monotone series, respec¬ 
tively. It can shown that 

T . _ A k (rik-1 (A n — A) / R n ) 

^ A k (n k -'/R n ) 

Let A r be of the form 

A r = A + R r f(r), r = 1,2 ,... , (5.3.6) 

where/(x) £ (7°° for all x > n, including x = oo and has a Poincare-type asymptotic 

o° ^ 

expansion f(y) ~ — as x —> oo, /?o 0. Then for Wk(x) defined by Wk(x) = 

i—0 

/c —i Q. 

fix) — Sidi (1979b) has proved that 

*=o x % 


A k [n k - 1 w k (n)} 
n ’ k A k [n k ~ 1 /R n } 


(5.3.7) 


where A Wk(x) = Wk(x + 1 ) — Wk(x). 

The convergence properties of Tk jU defined by (5.3.4) can be studied for two 
limiting processes: (i) k fixed, and n —> oo; and (ii) n fixed, and k —> oo. This study 
reveals the two noteworthy properties. 

1. Tk, n is a good approximation to A and converges to A very rapidly as k —> oo 
when A r is of the form (5.3.6), where f(x) has the asymptotic expansion f(y) ~ 

/?o + — + - ,asx—>oo,/?o y^ 0. The approximation Tk n is of no use in the 

case when A r is not of the form (5.3.6). 

2. Define R r = R r g(r ), where g(x) has the same properties as f(x) and the 
limit lim g(x) y^ 0. Then (5.3.6) can be written as A r = A-\- R r f(r),r = 1 , 2 ,..., 

x^_oo _ 

where /(r) = f(r)/g(r) and f(pc) has the same properties as f(x). Thus, the exact 
form of R r in (5.3.6) is not important and R r can be replaced by R r . 

3. For k —> oo it is of no consequence if R r in (5.3.4) is replaced by r s R r , where 
5 > 0 is an integer which is not too large. But 5 < 0 destroys the accuracy of T^ jn . 

5.3.4. Sidi’s Rules. In Sidi (1980a) the integrals considered are of the form 
Iq(w/), where the weight function w(x) is of different forms defined in Table 5.3.6, 
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which contain the most important algebraic and logarithmic endpoint singularities. 


Table 5.3.6. 


w(x) 

= fo wixjx™- 1 dx 

1 

1 

m 

— Lp p > —i 

m + p 

a\(m + j3 — 1)! 

/ , , “ > c P > 1 

(to + a + p)! 

i 

(1 — x) a x@ 

(\ogx) v 

v\ 

, , v > 1 

m v + 1 ^ 

x@ (\ogx) v 

( @ > 1, ^ ^ 1 
[m + p)^ +i 

(1 — x) a x@ (\ogx) u 

No explicit expression for general a , /?, v. 


where (3 > —1, a + z/ > — 1 


Let f(z) be an analytic function in every finite subset of a simply connected 
(open) domain D of the complex plane which contains the real semi-infinite interval 
[0, oo). Let T denote a Jordan curve in D , which contains this semi-infinite interval 
in its interior. Then by Cauchy’s theorem 

/ Lo) = [ -JLf dz, (5.3.8) 

2m J T z — zo 

r 

where zo is an interior point of T. Define Ao = 0, and A r = f 1 m / zTn • Then in the 

m=1 

last case of w(x) in Table 5.3.6, for every z not on the cut [0,1] we take H(z) — A r _ i 
of the form A r _ 1 = H(z) + R r f(r ), where R r = 1/ (r a+l/+1 z r ), and f(x) is the 
same function as defined in (5.3.6). The n-point Sidi’s rule Sk for the integral 7g (wf) 
is given by the quadrature formulas 

k 

!o( w f) ~ I n (wf) = Y^ w k,if ( x k,i), k = 1,2,..., (5.3.9) 

which are obtained after some rational approximations by applying a modification 
of Levin’s nonlinear sequence transformation to the moment series of the weight 
function w(pc). In these formulas all the abscissae (nodes) Xk,i lie in the interval [0,1] 
and their weights are all positive. In the case of endpoint singularities the nodes are 
the same and are independent of (3. If a + v is a small nonnegative integer like 0,1,2, 
the same nodes can be taken in all cases of w(x) listed in Table 5.3.6. 

Since the nodes Xk,i, being the zeros of certain known polynomials, are known an¬ 
alytically, the corresponding weights Wk,i are easily computed. The formulas (5.3.9) 
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possess very strong convergence properties and are as efficient as the corresponding 
Gaussian formulas. 

For w(x) = (1 — x) a xP (logx) u , (3 > —1, and a + v > 0 and very small like 

k 

0 , 1 , 2 , the nodes x^j are the roots of the polynomial equation A j z J = 0 , where 

3 =o 

A j = (—1 Q) ( j +1 ) k ,j = 0,1,... , k. These nodes for k = 2 ( 1)12 are presented 
in Table A.24. 

Another Sidi’s rule, denoted by , for Iq ( wf ), which is of the form (5.3.9), has a 

k 

different set of nodes Xk,i ; they are the roots of the polynomial equation A j z J = 0, 

3=0 

where A j = (—1 ) J (^) (j + 1 ) k ~ l , j = 0,1,... , k. Note that z = 1 is a node in Sk- 
These nodes for k = 2(1)12 are presented in Table A.25. 

For the weight functions w(x) = x a e ~ x , a > — 1, and w(x) = x a E m (x), a > 
— 1, a T m > 0, where E m (x) denotes the exponential integral ff° (e~ xt /t 771 ) dt , 

let A 0 = 0, A r = dk/z k , r = 1 , 2 ,..., and R r = + r —Hl r -i f or 

k =1 

r = 1,2,_Then the modified T-transformation is given by 

E (-TQ (« + j ) k ~ 1 Lj-i/Uj 

Tfc,n = -, (5.3.10) 

E(-T(?) (n + T-7*Wi 
1=0 


Notice that the nodes Xk,% are not symmetric with respect to x = 0.5 for w(x) = 1 
or for any other weight function which is symmetric with respect to x = 0.5. Tables 
A.24 and A.25 show that many of the nodes Xk,% cluster about x = 0 as k gets large. 
To obtain symmetric rules, consider the integral /I 1 (i^/), where w(x) is an even 
function, and define 


dm — 



m = 1 , 2 ,... . 


(5.3.11) 


Then 



w(x) 
z — X 


oo 

dx = 

ra= 1 


dm 

^2m-l ’ 


(5.3.12) 


OO jj^ Q 

Now, set A 0 = 0, A r = r = 1 , 2 ,..., and R n = 2r r _i > r = l,2,..., 

m =1 ^ ^ 

in (5.3.4) and simplify the rational function for Tk, n so obtained. Then Tk, n will 
have simple poles if n = 1 or n = 2. For n = 1, the numerator of is an odd 
polynomial of degree 2 k — 1, and its denominator is an even polynomial of degree 
2k. Thus, i gives a 2k -point quadrature rule. But for n = 2, the numerator of 
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Tk ,2 is an even polynomial of degree 2 k, and its denominator is an odd polynomial 
of degree 2k + 1. Thus, T k ^ provides a (2k + 1)-point quadrature rule. For these 
two rules, if £ is a node, so is —£ and their corresponding weights are the same. 

Example 5.3.6. Consider w(x) = 1. Then /i m = 2/(2 m — 1), m = 1,2,_ 

Choose _R r = 1/ (r z 2r_1 ), r = 1, 2,_Then the denominator of i is 

^ Aj z 2 - 7 , where Aj = (—1 ) J f ^ (j + l) fe , j = 0,1,... , fc, (5.3.13) 
j=o ^ 

and the denominator of 7*^2 is 


X>* 2 ' +1 , where \j = (-1) J (A (j + 2) k , j = 0,1,..., k, (5.3.14) 
1=0 

Thus, all the poles of T k ,i andT /^2 lie in (—1,1). If we replace (j-\-l) k in (5.3.13) by 
(j +1)^ -1 and (j + 2) k in (5.3.14) by (j + 2) /c_1 , the endpoints ±1 are also included 
in the nodes, thus giving (closed) Lobatto-type formulas. See SidiNodes .nb on the 
CD-R for computational details. ■ 

5.3.5. Infinite Range Integration. Sidi (1980b, 1982) has derived new 
interpolatory-type quadrature formulas for infinite range integrals which have alge¬ 
braic or logarithmic endpoint singularities. Such integrals are of the form J o°(W)> 
where w(x) = x a e~ x or w(x) = x a E m (x), a > —1, a + m > 0. The modified 
T-transformation (5.3.4) becomes 


E(-T(-) A n+3~1 /Rn+J 

T k ,n = - (5.3.15) 

E(-TO) (n + j) k ->/Rn +j 

3=0 


which, after cancelling a factor of z from the numerator and the denominator, yields 


Tk,n = 


/_i \j (k\ ( n j) _ a 

fi ( } W (a -h n -h j — 1)! An+J ~ 1 


(-i)i ( fe ) — — 
j=o (a + n + j-l)! 


(5.3.16) 


z n+j-l 


The n -point Sidi’s rule S k for the integral 2 q° (wf) is given by the quadrature formulas 


I?(wf) « Jnif ) = E Wn ’ k f > (5.3.17) 

fc=l 
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where the nodes x n ^ are distinct. Let 

H ^ = J 0 Tpp dx ' Hk{z) = E 2 W _% . • A 3 - 18 ) 

The function H(z) is analytic in the z-plane cut along the positive real axis [0, oo) 
and has the divergent asymptotic expansion 


oo 

H(z ) ~ as z —> oo, z ^ [0, oo), (5.3.19) 

n=l ZU 


where v n = / 0 °° w(x) x n ~ x dx denote the moments of w(x). If we require that 
the sequence of rational functions H k (z) tend to H(z) uniformly and rapidly in any 
region of the complex plane that is at a finite distance from the positive real axis, 
then the error E k (f) = — /&(/) will approach zero rapidly as k —> oo. The 

success of Sidi’s quadrature rule depends on assuming that H(z) satisfies a relation 
of the form 

71—1 

H(z) = E 5 J + R nf(n), (5.3.20) 

2=1 


where R n depends on the moments, and f(y ) £ C^O, oo) has an asymptotic 

°° Pi 

expansion of the form f(y) E —r as y —> oo. Sidi has shown that (i) for 

2 = 0 ^ 


w(x) = x a e x , a > — 1, the assumption (5.3.20) is satisfied for all z £ [0, oo) with 
My k = (a + k — 1)! for k = 1, 2,..., R n = ^ ^ ——, and 


^)~E-gS—^ c el a)5 exp(ze«) 


fc = 0 


<9^ 


e=o 


as?/ 


oo; 


and (ii) for rc(x) = x a E m (x), a > 
k = 1 , 2 ,..., and i? n the same as in 


. ~ (a + k — 1)! 

— 1, m + > 0, with fL k =---lor 

m + + k — 1 

(i), and /(y) ~ ^ ze k( z ) as y ^ where 

fc =0 ^ 


<9 fe 

e *( z ) = ^ 




exp (z e £ ) jP (1 ~ m)U exp {-ze u ) du 


J«=o 


The Sidi’s k -point quadrature rule S k , defined by (5.3.17) for Iq° ( wf ), is derived us¬ 
ing the modified T -transformation (5.3.16), which yields the following value of H n (z) 
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valid for the weight functions w{x) = x a e x , a > —1, and w(x) = x a i? m (x), 
a > —1, m + a > 0: 


H k (z) = T kj i 


j=o 


l) fc . 

7-t 


a + 4 fc z j 

j=o + 


NkXz) 

Dk,i(z)' 


(5.3.21) 


The nodes x k ^ are the poles of H k (z); i.e., they are the zeros of the denominator 
Dk,i(z) which are simple, and the weights w k ^ are the residues of H k (z) at the 
corresponding x k ,i, given by 


Wk,i — 


NkXz) 

U,i(4 


z=x kji 


(5.3.22) 


where ' = d/dz. The values of the nodes x k ,i for n = 2(1)12 are given in Table 
A.24, and the corresponding weights w njk for w(x) = e~ x are given in Table A.25 
and for w(x) = E\{pc) in Table A.26. Note the slight difference between the results 
presented in the above tables and those given in Sidi (1980a, 1882a), which is due to 
the machine precision of different computers used in their evaluation. The nodes x k ,i 

k 

of Sidi’s formulas ’ w(x) f(x) dx f (xi), where w(x) = x a e x (Case 

i=l 

1), or w{x) = x a E p (x), p > 1 (Case 2), are given in Table A.27. The weights A kj i 
for these two cases are given separately, but the nodes remain the same in both cases. 


5.4. Singular and Hypersingular Integrals 

Let a function f(x), a <x< b, be unbounded at some point x$ £ (a, b). Assume that 
/ is Riemann integrable over the subintervals [a, x$ — 6) c [a, xq) and (xo -hS,b) C 
(xo, b\ for any 6 > 0. Then the Cauchy’s principal value (p.v.) integral of / over 
(a, b] is defined by 

b / rxo — 6 rb \ 

f(x)dx= lim ( / f{x)dx+ / f{x)dx ], (5.4.1) 

<5^0+ \ Ja Jx o+6 ) 

provided that this limit exists. The Cauchy’s p.v. integral (5.4.1) is well defined 
whenever / is an improper Riemann-integrable on [a, b\. The point xo is called a 
weak singularity of /. For example, the function f{x) = 1 + 1/x is not properly 
Riemann-integrable over (0,1], because 

lim (l -\-—\dx= lim [l — A — InAl = -foe. 

V x) <5—^0+ L J 
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Similarly, one can show that the improper integral of / over [—1,0) does not exist. 
But the Cauchy’s p.v. integral of / over [—1,1] exists and is given by 


£ (l-\—dx = lim [ (l-\—dx + [ (l-\—dx 
1 V xJ 6 ^ 0 + L 7-1 V T/ J 6 V xJ 


= 2 . 


In the case of an unbounded range of integration, let / be Riemann-integrable 
on all finite subintervals [a, b] C R. Then the Cauchy’s p.v. integral of / over 
(—oo, oo) is defined as 



(5.4.2) 


provided that this limit exists. As an example, consider f(pc) = xj (l + x 2 ), for 
which 

f R x 

lim / -- dx = lim 1 In (l + R 2 ) = +oo. 

R^oo J o 1 + X 2 R^oo 2 V ' 

Thus, this function is not improperly Riemann-integrable over (— 00 , 00 ), but its 
Cauchy’s p.v. integral exists and has the value 

/ oo r R 

X / X 7 .. 

-- dx = lim / -- dx = lim 0 = 0 . ■ 

- oo 1 + T 2 R^oo J 1 + X 2 R—^00 


A common p.v. integral is the Hilbert transform 



f (h) 

-dt, where —00 < a < b < 

t — x 


00 , and a < x < b. A sufficient condition for the Hilbert transform to exist over a 
finite interval [a, 6 ] is that /(£) satisfy a Lipschitz or Holder condition in [a, 6 ]; i.e., 
there are constants A > 0 and 0 < a < 1 such that for any two points T\ , £2 C [a, 6 ] 
we have |/(ii) - f (t 2 ) \ < A\h -t 2 \ a . 


Another type of singular integrals is known as the Hadamard finite-part inte¬ 
grals , or hypersingular integrals ; they are defined by 


r b 

4 (x — a) x ~ n f(x) dx 

J a 

■ r h 

/ (x — a) x ~ n f(x) dx — g(R)(R — a) 
-Jr 


= lim 

R^a+ L 


A—n +1 


(5.4.3) 


where — 1 < A < 0, / £ C n [a , b] f(s) 0, and g(R) is any function in C n [a , b] 
such that the limit exists and diverges for all positive integers n. 

Consider a singular integral over the interval [a, b] such that the integrand has a 

singularity of the type-at an interior point 5, a < s < b, and the regular part of 

x — s 

the integrand is a function fi(x) £ C° [a, b] that satisfies the Holder condition 

\fi{x) — 0 ( 5 )| < A \x — s| a , 
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where 0 < a < 1, and \A\ < oo. Then the Cauchy p.v. integral is defined by 


fm dx=lim ir + r )m iXt 

J a x-s e^ 0 \ J a J s+s J x-s 


a < s < b, (5.4.4) 


rm lke=liI jr 

J a X-S £-°l. J a 

Js X-S e^O lj s ^ 


s ~ £ <Kx 


dx — d 


■dx + d> 


p(s) lnej, 
(s) lnej, 


(5.4.5) 


provided these limiting processes are taken together, since each of them does not exist 
independently. In fact, using the identity 


Ja X-S J a X 


-^) ^+ r”jh_ 

, X — S J n X - 5 


and (5.1.3), we find that 


fm dx= i b m. 

J a X-S J a X 


— 6(s) . , . , b — s 

V 7 +<b(s) In-. 


(5.4.6) 


since <j)(x) satisfies the Holder condition on [a, 6 ]. 

Example 5.4.1. Let a Cauchy p.v. integral, denoted by C u (s), be defined by 


44 =f — 

Jo x-s 


dx, 0 < s < 1 , v > — 1 . 


Then the following results hold for rational v\ 


(i) CWi(s) = sC u (s) 


(ii) C v (s) = — TVS 1 ' cot 7 TV — 


- — 1 < v < 0 , v not integer: A 

n — v t 0 . 4 AJ 


/ 1 — 5 \ . n A s n — k 

(iii) C n (s) = s n In l -J + —-— for integer n. 

\ s y /c 


Proof, (i) Take x = x — s + s; then 


C v+ 1 (s) = 


f 1 x v+1 , f 1 „ , f 1 x v 

+ - dx = / x dx + 5 -f - 

Jo X-S J 0 Jo X-s 
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which proves the result. 

(ii) For —1 < v < 0, set x = su\ then 


a( S )= l 1 — dx = s " -j-^ ——— 

Jo X- S Jo x - 1 


dx 


l 


x — 1 


■ <Jx 


= — TVS 1 ' cot 7TP — S l 


= —ITS 1 ' COt 7TU — 


S 


n — v 


dz , where x = l/z, 


n =0 


n — v 


— 1 < p < 0, v ^ n. 


where we have used 


.. oo 

— = Y< 

1-5 ^ 


n =0 


(iii) For v = n (integer) we use recursion and get 

' 1 — 


Ci 0 ) = f 

JO 

(-) = / 
Jo 

Cs(s) = / 

Jo 


dx = In I 

Q ^ — 5 \ 5 


Z , 1 , /l-s 

- dx = 1 — s In 


1 x 2 


C 2 (s) = 4 - —— da; = I + s + s 2 In (I—- 
l 0 x — s 2 Vs 

1 T 3 


7 1 5 9 q, / 1-5 

- dx = —| - b s 2 + 5 3 In (- 

x — s 3 2 V 5 


and so on. Thus, by induction we have 

C n (s) = s n In (E-?) + s”- 1 + AL + • • • + 


' 1 — 
5 

'1 — 
5 


0 n—2 


-”"'(U)+£ 


c n—k 


k =1 


Example 5.4.2. If we denote the Cauchy p.v. integral by 


h i u = C 1/ (s) = 


dx , 0 < 5 < 1, 


then by repeated differentiation we obtain the integral for positive integer a as 


J-n/.u — 


/‘ 


(x — s)< 


dx, 0 < 5 < 1. 


(5.4.8) 
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For proof, see Bertram and Ruehr (1992) and Kythe and Puri (2002). ■ 

5.4.1. P.V. of a Singular Integral on a Contour. Consider the singular 
integral 


£ 


<m 

c-z 


d( for z, C G r, 


on a contour T with endpoints a and b (a = b if T is closed). Draw a circle of radius 
p with center at a point z £ T, and let z\ and ^2 be the points of intersection of 
this circle with T. We take p small enough so that the circle has no other points of 
intersection with T. Let 7 denote the part of the contour T cut out by this circle. Then 

ho 


the integral on the remaining contour V — 7 


of the singular integral (5.2.1) is given by lim 


iS Jr 

im / 

'-*°J r- 


—'Y C Z 

ho 


and the principal value 


p^ u J r-7 C ~ z 




dC,. Since 

dC 

<-z’ 


we find in the same way that the singular integral (5.2.1) exists as a Cauchy p.v. 
integral for any function </>(£) that satisfies the Holder condition, and 


/r 


C ~ z Jr 




or 


m«-k 


(- Z 

HO - Hz) 

C-z 


d( + H z ) ( 


, b — z 

In-b n r 

z — a 


r 


Moreover, if the contour T is closed, then we let a = b and obtain 


£ 




Jr C ~ z Jr C z 

Now consider the Cauchy-type integral 


^) = 


1 

2 iir 


£ 


m 

C-z 


d(, 


(5.4.9) 


where T is a closed or nonclosed contour and </>(£) satisfies the Holder condition on 
T. This integral has limit values 4> + (z) and 4> - (z) at any point z G T (z not equal to 
a or b) as z —> ( from the left or from the right, respectively, along any path. These 
two limit values can be expressed in terms of the function </>(£), which is known as 
the density of the integral, by the Plemelj formulas 


4>+(z) 



(5.4.10) 
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such that 


$+(*) + $-(*) = - / 

m J T 


m 

c-z 


d(, 


$ + (z) — <f> (z) = (j)(z). 

If r is the real axis, then the Plemelj formulas become 

<t>(s) 


oo 


$ 


S — X 

1 , / x 1 [°° fa) , 

(x) — —~ 0 (t) A ~— / - ds , 

2 Y 2m J_ 00 s — x 


and 


$ + (°°) = \ <K°°), $ (oo) = 


Hence, from (5.4.12) and (5.4.13) we have 


$ + (oo)A$ (oo) = 0, lim -f 

J_ c 




ds = 0. 


s — x 


(5.4.11) 


(5.4.12) 


(5.4.13) 


(5.4.14) 


We use the first property in (5.4.14) to represent a piecewise analytic function 
in the upper and the lower half-plane by an integral over the real axis. Consider a 
Cauchy-type integral over the real axis: 

<$>(z) = —I 2M dx , (5.4.15) 

2*?r J_ OQ x - z 


where z is complex and &(z) is a complex-valued function of a real variable x, which 
satisfies the Holder condition on the real axis. If a function (j){pc) is analytic on the 
upper half-plane D + , is continuous on the closed upper half-plane, and satisfies the 
Holder condition on the real axis, then 


cj)(z) — ^ cj)( oo) for 2 s{z} > 0, 
— ^ 0(oo) for^{z}<0 ; 

also, 


1 

2 iir 


l r 

™ J-c 


X — Z 


dx = < 


(5.4.16) 


j_ r #-0 -«°°) = J 

2 m J_ OQ x - z 


^ 0(oo) for 2s{z} > 0, 

—(f)(z) + ^ 0(oo) for 2s{z} < 0, 


(5.4.17) 


provided (j>{z) is analytic on the lower half-plane D , is continuous on the closed 
lower half-plane, and satisfies the Holder condition on the real axis. 
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Example 5.4.3. If r = {\z\ = l}, and 0(C) = 
0(oo) = 0, then 


1 1 , 
— -, and 


$(z) = — l - -—l 

2iir J r ( — 2 ( — z 2iir J r 


C(C - 2) C - 2 c 
d( 1 f 1 d( 


= < 


r s — 2 C z 2iir J r C C ~ z 
— - for 2s{z} > 0, 


z — 2 z 

1 


for z} < 0, 


by (5.4.16) and (5.4.17). Hence, 


4> + (z) =-- and <f> (z) = -. i 


Another useful formula is the Poincare-Bertrand formula : 

i f d( l f g(CCi) „ , N , i f „ 1 f 

— I 7-' — / "7—7“ — 9 \ z i z ) + — j- dCi • — j~ 77 777—> x 

inJrt-z ^7r C — Ci ^7r ^7r (C - *) (C - Ci) 


dC, 


or, alternatively, 

g(CXi) 


i A l U7 * - * 2 ^ + / r * i 


5 (C) Ci) 


r (C - 4 (C - Cl) 


(5.4.18) 
d(, (5.4.19) 


where the function g (£, ( 1 ) satisfies the Holder condition with respect to both vari¬ 
ables. This formula is useful when changing the order of integration in singular 
integrals. Thus, the pair of iterated singular integrals 


m = - / 7 ^ • - / 

w Jr C ~ z 2 tt J t 


g(C,Ci) 


Jv C — z 

G(0 = 

iir J T 11 r J T 


d( 1 , 


r C Ci 
9(C,Ci) 
(C~ z ) (C-Ci) 


dc, 


are not equal, although they differ in the order of integration. 

5.4.2. Application to Cauchy P.V. Integrals. For the sake of simplicity 
we assume that all poles 24 , £ 2 , • • • are simple and situated on the real axis. In such 
a case Eqs (5.1.30) and (5.1.32) still hold, but Eq (5.1.31) becomes 


+ 

R( A, ft,, c) = 7T p m 1 cot 7T 

m 



(5.4.20) 


provided none of the values of z m /h — X are integers. In the case of just one pole 24 , 
we can choose A such that 24 /ft — A has a fractional part and thus, I?(A, ft, c) = 0 . 
In this way we try to avoid loss of accuracy which can occur if T(A, ft) and R( A, ft, c) 
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are large and of opposite sign. But in the case of several poles we cannot choose A 
and h easily, especially when / is an even function; then A is chosen as 0 or 0.5. 

soch z 

Example 5.4.4. Consider f(z) = -, a > 0 real; this function has 

z — a 

a simple pole at z\ = a, with residue pn = secha, which gives i?(A, ft, c) = 
7r sech a cot n{a/h — A). We take X = a/h— [a/h\±^, where the sign =b is chosen 
so that 0 < A < 1. Then R( A, ft,, c) = 0, and T*(A, ft) = T(A, ft). For example, 
for a — 0.1, ft = 0.5, we choose A — 0.7; this gives T*(0.7,0.5, c) = T(0.7,0.5) = 

2 ?r 

—0.2322322. The error is given by |E(A, ft, c)\ < — | secc| ( e 27rc /^ — 1), where 

0 < c < 7 t/ 2 , since the poles are at ±27 t/ 2. For ft = 0.5 the maximum value 
of the error bound occurs at c = 1.5, which yields |E(A, ft, c)| < 3.8564 x 10 -7 . 
The accuracy can be improved by taking some of the poles on the imaginary axis at 

z = (m — 0.5) in, with residue p m = -;--—. If we set c = nn and let 

v 7 H a — (m — 0.5) in 

n —> oo, then E( A, ft, c) 0, which implies that /^^(Z) = T*(A, h) + 5(A, h), 

where 

S(A, ft) = 4 tt V f e ( 2m - 1 ) w2 A+2Ai7 r _ O \ (5.4.21) 

v ^ \ a - (m - 0.5) ^7^ V U ’ 


The sum on the right converges very rapidly; for example, fora = 0.1,/i = 0.5 and 
A = 0.7 the first two terms in this sum are —2.0691979 x 10 -8 and 4, 8873714 x 

nr 26 . ■ 


5.4.3. Hadamard’s Finite-Part Integrals. Consider an improper integral 

on the interval [a, b] such that (i) the integrand has a singularity of the type - - — 

(.x — s) z 

at an interior point s, a < s < b, and (ii) the regular part of the integrand is a function 
(j)(pc), a < x < b, which satisfies a Holder continuous first-derivative condition 


<j)(x) — 4>(s) — (x — s) 4>'(s)\ < A \x — 5 | a+1 , 


where 0 < a < 1 and \A\ < oo, as before. Then a Hadamard’s (finite-part) integral 
is defined by 


/ 

J a 


-^%;dx= lim 

(x - S) 2 £—^0 


<-> 


where the neighborhood £ is symmetric about the singular point 5 . This integral can 
also be evaluated on both sides of the singular point as first-order one-sided integrals 


l 

i 


s 


b 


HP 

(x — S ) 2 


dx = lim 

e^0 


HP 

(x — S ) 2 


dx = lim 

e^0 


a 


HP 

(x — S ) 2 


dx — 


HP 

£ 



f ‘ 

S+£ X - S £ 
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both of which must be taken together. 

Differentiation of the Cauchy p.v. integrals with respect to 5 is carried out by 
using the Leibniz rule (1.1.5), which yields 


d_ 

ds 



lim 

£—>o ds 


(U + /) 


X — S 


dx 


= lim 




4 >( x ) 

(x - s)‘ 


■ dx — 


(s — s) + < 


-e) 


}■ 


(5.4.23) 

Since (j) is continuous on a < x < 6, we have c/)(s — e) = c/)(s + s) = (j)(s) as £ —> 0. 
Then formula (5.4.23) becomes 


d 

ds 


f 


*M dx = lim 

X — S £—^0 




\ <t>(x) 

. J x — s 


(5.4.24) 


l S + £ / X - S £ 

which is the same as (5.4.22). Hence, we obtain the formula 


d_ 

ds 


/«£!*=/_«£) dx , (5.4.25) 

Ja X-S J a (X-S ) 2 

which is very useful in evaluating Hadamard’s finite-part integrals. 

5.4.4. Two-Sided Finite-Part Integrals. If we take <j){x) = <j){x) — 
4>(s) + 4>(s) in the Cauchy p.v. integral (D.2.1), then 




<f>(x) - 4>(s) 

X — S 


dx 


J a 


dx 


x — s 


where 




(5.4.26) 


(5.4.27) 


If (j) £ C 1 [a,5], the continuity requirement on (j)'{x) is a necessary condition for 
a Taylor’s series expansion of the function (j){pc). But if (j>(x) 0 C 1 , i.e., it does 
not have a high degree of continuity so as not to allow a Taylor’s series expansion, a 
sufficient condition for the existence of finite-part integral is that <j)(x) satisfy a Holder 
or Lipschitz condition, i.e., \<j)(x) — c/)(s) | < A \x — s| a , 0 < a < 1, \A\ < oo. This 
condition also guarantees that the first integral on the right side of (5.4.26) is, at most, 
weakly singular. Now, integrating (5.4.4) by parts we get 


f 0( x ) = 0(M In 16 — ^1 — cj)(a ) In la — s\ — [ <j)'(x) In \x — s\dx, (5.4.28) 

Ja x ~ s Ja 

where <j)(x) G C 1 [a, b\. Then differentiation of (5.4.28) with respect to s yields 


i i > m dx= m-m + i b £i2i <ht 

ds J a x — s a — s b — s J a x — s 


(5.4.29) 
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where c/)'(x) satisfies the Holder condition \(/)' {x\) — <$>' (X 2 ) | < A — £ 2 ^• 
Similarly, the finite-part integral of (j)(pc) G C 2 [a, b\ is defined by 


f 


H x ) 

(.x — s)‘ 


* (s) i 


(x) — 4>(s) — (x — s)(j)'(s) 
(x — s ) 2 
rb dx 


dx 


dx 


x — s 


(5.4.30) 


where on the right side the last integral is evaluated in (5.4.27), while the second 
integral is given by 


f b dx 

Ja 


1 1 1 


X — 5 J a 


a — s b — s’ 


In the case when <j){x) 0 C 2 , i.e., it does not have a high degree of continuity to allow 
a Taylor’s series expansion, a sufficient condition for the existence of the finite-part 
integral in (5.4.30) is that (j)(pc) satisfy a Holder-continuous first derivative condition 
as in §5.2, which also guarantees that the first integral on the right side of (5.4.30) is, 
at most, weakly singular. 

Integrating a finite-part integral by parts we get 


l 


b 


4>( x ) 

(x — s) 2 


dx 


H a ) _ H b ) + [ b <t>'(x) dx 

a — s b — s J a x — s 


(5.4.31) 


where (j){pc) G C 1 [a, b] satisfies the Holder condition. If we compare (5.4.31) and 
(5.4.29), we obtain 


d 

ds 



4>(x) 

{x — s) 2 


dx, 


which shows that differentiation can be carried out under the integral sign. 

5.4.5. One-Sided Finite-Part Integrals. Consider the case when the 
integrand has a singularity at an endpoint of the interval [a, b], that is, either a = s o r 
b = s. Then the finite-part of a first-order function <j){x) G C 1 [a,s\ or0(x) G C x [s,b\ 
is defined, respectively, by 


or 



x — s 


dx = 



4>(x) - <j){s) ±r 

X — S 



dx 


x — s 



4>{x) 

x — s 


dx = 


t * {X) - dx 

Js X - S 



dx 

X — 5 5 


(5.4.32) 


(5.4.33) 
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where 


or 


r S 

j- -= finite part of [in \x — s|] * = — In \a — s|, 

j- dx _ g n | te p art | x _ 5 |j ^ = In \ b — s|, 

J s T — 5 


If (j){pc) ^ C 1 , a sufficient condition for the existence of the finite-part integrals in 
(5.4.32) and (5.4.33) is that <j>{x) £ (7° and satisfies a Holder condition. If we use 
(5.4.32) and (5.4.33) to derive (5.4.26), we find that finite-part integrals exist iff the 
function <j)(x) is continuous at the singular point s. 


Similarly, the second-order one-sided finite-part integral of a function <j)(x) £ C 2 
is given by 


Ja ( x - s r Ja 


- (j>(s) -(x- s) 0 '(s) 


dx= i y v ' dx 

(,x — s) z 




dx 


x — s 


(5.4.34) 


or 




(x) — 4>(s) — (x — s)(j)'(s) 


dx 


dx 


x — s 


(5.4.35) 


according as the singularity is at the endpoint b or the endpoint a of the interval [a, b ]. 
In these cases then 


f 


dx 


(x — s)‘ 


= finite part of 


x — S J a a — s 


or 

j b dx r i -\ b i 

4 7 - -7 = finite part of-=- 

J s (x — s) z L x — sis s — b 

respectively. If <j){x) 0 (7 2 , a sufficient condition for the existence of the finite-part 
integrals in (5.4.34) and (5.4.35) is that f(pc) £ C 1 and satisfy a Holder condition. If 
we use (5.4.32) and (5.4.33) to derive (5.4.26), we find that finite-part integrals exist 
iff the function (j)'{x) is continuous at the singular point 5. 

Example 5.4.5. First, we define the Hadamard transform H2[4>\ for a function 
(j>{x) as 

H 2 [4>\ = =£ ^ X \o 0 < ^ < 1. (5.4.36) 

Jo \ x ~ s ) 
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Notice that this transform is the integral The results, given in Table 5.4.5, hold 
for various choices of the function <fi. 

Note that if the function cj)(x ) £ C 2 [a, b] satisfies a Holder-continuous second- 
derivative condition, then Hadamard’s second-order two-sided finite-part integrals 

contain the singular part 7 -— and can be defined as above (see Ioakimidas 1988, 

(,x — s )' 3 

for details). This concept can be generalized further, but we shall not go into this 
generalization. Kutt (1975) contains weights to 305* for the equally spaced rule 

£ ^r dx ~ib wi f (■)* n= 3 (i) 2 °’ 

and the nodes Xi and weights Wi to 30 S for the Gauss-type quadrature rule 


=f dx^y^Wif (Xj ), n = 2(1)20, 

Jo x i =1 


forA = 1,4/3,3/2, 5/3, 2, 3,4,5. This work also contains weights for computation 
of the finite-part integrals of the form 

=f T J ^% [ dx, A = 2,3,4,5 
Jo (x-s) 4 

for the equally spaced case. ■ 


5.5. Computer-Aided Derivations 

We will consider Cauchy p.v. integrals and the related hypersingular (finite part) 
integrals of the form 

I(y) = l w(x) dx, a<y<b , (5.5.1) 

Ja x-y 

Mv) =4 w ( x )7 - 7^ dx ’ a<y<b,p = 1 , 2 ,... 

Ja (x-y)P (5 .5. 2) 

where Ji(y) = I(y)- First, we give Mathematica code for the Gauss-Chebyshev 
and Gauss-Legendre rules; then we consider the problem where the singular point 
y coincides with a node, which leads to the computation of the related p.v. integral 
Qo(y)-- 

*‘S’ means ‘significant digits’. 
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Table 5.4.5. 


H s ) 




s v (v rational) 


OO gTl 

— TUJS V ~ l cot 1\V - V y2 - 

1 — 5 n = 0 R — P T 1 


a m— 1 


5 m (m integer) 


a m— 1 


In ■ 


1 — 5 


S rn (7) S m -^[( S 1 - sy- 1 - (-s)^- 1 ] 

+ E —-: i- 

3=2 3 ~ 1 




s(l - s) 


3/2 


S — C 

2\s-c\ 


5 — 1 C — 5 


— [c + (1 — 2 c)5 + 15 — c| 


(c — 1) In \s\ — c In |1 — s\ + In \s — c\ 


1 


1 


2 + i [l*-c + e| + |s-c-e|] ^ ^ 


S — c — £ 


S — C + £ 


3 1 

/ c 2 1 \ | 1 

-(s-c) 2 --(s-c)|s-c| 

c+ 1 +( S+T --) In 11 — s | 

+ ^( s “ c ) (c 2 + 2c — l) 

+(5 — c) In 5 — c 

+^-i) 

~( 2s + £~ c ~\) ln > s i 

sin 7T5 

— 7 r sin 7T5 [Si (7r(l — 5 )) + Si(7T5)] 


+7r COS 7T5 [Ci(7T5) — Ci (7r(l — 5 )) ] 


qo(y) = / w(t) dz, a < y < b, (5.5.3) 

Ja x-y 

where po(x) = 1, and p n (x) denotes the polynomial whose roots are the nodes of 
the quadrature rule, i.e., p n (x) = T n (x) or P n (x) for the Gauss-Chebyshev or the 
Gauss-Legendre rule, respectively. 

For the Cauchy p.v. integral (5.5.1) we consider the singularity at x = y. As¬ 
suming that g £ C 1 [a, 6], we rewrite (5.5.1) by using (5.5.3) as 

I(y)= f w(x) _ 9 ^ dx + q 0 (y)g(y), (5.5.4) 

Ja X y 

where the integral is now regular. In the case of J p (y) we write (5.5.2) as an appro¬ 
priate derivative of I(y): 

1 dp -1 

Jp{y) = j^)\d^ I{y) ' P = 1 ,2 . (5 - 5 - 5) 
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We then use an interpolatory or Gaussian rule of the general form 

rb 


/ w(x)f(x)dx = E ^ k,n f (%k,n) 

^ a k =1 


■ E n 


(5.5.6) 


where Xk, n denote the nodes, Wk, n the related weights, and E n the error term. 
Ioakimidis (1992) has provided Mathematica code to derive quadrature rules for 
singular and hypersingular integrals. The results are as follows. 

5.5.1. Gauss-Chebyshev Rule. For the classical Gauss-Chebychev rule 
we have w(x) = y/l — x 2 , and 

/ I _ n 

a/1 /(t) dx = ^ ^ Wk^n f (%k,n) T E n , (5.5.7) 

_1 k =1 


where qo(y) = —tv y , and 


%n,k — COS 


(2k — 1 )tv 
2 n 


"? ^k,n — 


1 - x l,k ) * 


k = 1 , 2 , 


(5.5.8) 


Then for n = 3 and p = 1: 

_ 7r /^O.O8333330(-O.866O25) 0(0) , 0.0833333^(0.866025) 


—0.866025 — y 3 y 

(-0.75 + 3.75 ?/ 2 - 3 y 4 )g{yY 


0.866025 - y 

4 )g(.y) \. 

' -2.25y + 3 y 3 )' 

for n = 3 and p = 2: 

/ °.° 833333 (?(— 0 - 866 ° 2 5) 3 ( 0 ) 0.08333333(0.866025) 

^ ~~ W V (-0.866025 - y ) 2 + V" + (0.866025 - y ) 2 

(-1.6875 - 1.6875?/ 2 + 9 y 4 - 9 y 6 ) g(y) (-0.75 + 3.75 y 2 - 3y 4 ) 3 '( 3 ) 
y 2 (—2.25 + 33 2 ) 2 —2.25y + 3 y 3 

and for n = 3 and p= 3: 

^ _ IT /^0.1666673(-0.866025) 23 ( 0 ) , 0.1666673(0.866025) 


2 V (-0.866025 - y) 3 3y 3 (0.866025 - y) 3 

(-7.59375 + 30.375y 2 - 20.253 4 + 27 y 6 ) g{y) 
y 2 (-2.25 + 3y 2 ) 2 (-2.25 y + 3y 3 ) 

(-3.375 - 3 . 3753 2 + I 83 4 - I 83 6 ) g'(y) 
y 1 (-2.25 + 3 3 2 ) 2 

(-0.75 + 3.75 y 2 - 3 y 4 ) g"(y) 

+ -2.25 y + 3 y 3 
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5.5.2. Gauss-Legendre Rule. For the classical Gauss-Chebychev rule we have 
w(x) = 1, and 



n 

dx = E 16 k,n f + Em 

k =1 


(5.5.9) 


where qo(y) = log (-—-Y and x n & are the zeros of the Legendre polynomials 
VI + vJ 


^1 + 2 / 

P n (x) and the weights Wk, n are given by 




2(l-< fe ) 

(n + l) 2 A+i i x k,n) ’ 


(5.5.10) 


Then for n = 4 and p = 1: 

_ 0.347855 g(—0.861136) 0.6521453(-0.339981) 

(V ’ ~ —0.861136 — y + -0.339981 - y 

0.652145 3(0.339981) 0.347855 3(0.861136) 

+ 0.339981 - y + 0.861136 - y 

(-1.047623 + 23 s + (0.0857143 - 0.857143 y 2 + y 4 ) log 3(3) 
+ 0.0867143 - 0.8571433 2 + 3 4 


and for n = 4 and p = 2: 

_ 0.347855 3(—0.861136) 0.6521453(-0.339981) 

^ “ (-0.861136 -3) 2 + (-0.339981 - y) 2 

0.652145 3(0.339981) 0.347855 3(0.861136) 

+ (0.339981 - y) 2 + (0.861136 - 3) 2 

_ 0-104493(3) _ 

(1 - 3)(1 + 3) (0.0857143 - 0.8571433 2 + 3 4 ) 2 
(-1.047623 + 2 y 3 + (0.0857143 - 0.857143 3 2 + y 4 ) log g'(y) 
+ 0.0867143 - 0.8571433 2 + 3 4 


5.5.3. Singular Point as a Node. In the case of the Gauss-Legendre 
quadrature rule, if y = x m?n (m = 1,2,... , n), we have (Ioakimidis and Theocaris 
1977) 


I (x. 

= V 


>+ 




27 {%k,m) 


■ dx 


%k,m 

k^m 


+ ^m,n 9 (t m,n ) + w m,n 5 (a? m,n ) + E n , (5.5.11) 
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where the new weights w m , n are given by 

Qn— 1 ( %m,n ) 


Wr, 


= -2 


Pfi—l (%m,n) 


— (n + 1 ) 


1 — 0^2 5 
^m,n 


(5.5.12) 


and Q n (x) denotes the classical Legendre function of the second kind which is defined 
by (Abramowitz and Stegun 1968, p. 334) 

\ 1 _|_ x \ 

Qn{%) = R Pn{pc) 1ft Z ^ ^ Pm—l{P) Pn—m {%)• 

2 1 — x ' m 

m =1 

While using Mathematica, we can obtain the form of the Gauss-Legendre quadrature 
rule for y = x m?n by means of a limiting process for a particular value of m. Thus, 
the results for n = 4 nodes and p = 1 (Cauchy singular integrals) with the Gauss- 
Legendre rule for all four nodes Xk, 4 , as given below, also contain analogous results 
for the first node x\^ in the case when p = 2 and p = 3 (hypersingular integrals). 
This gives the values of w m ^ n for p = 1, which match the values given by (5.5.12). 
The results are: 


lim I(y) = -0.201974#(-0.861136) -0.542949 #(—0.339981) 

y^x 1,4 

-1.25135#(0.339981) - 0.599181 #(0.861136) + 0.347855#'(0.861136); 
lim I(y) = 0.599181 #(-0.861136) + 1.25135 #(-0.339981) 

y^X 2,4 

+0.542949 #(0.339981)+0.201974 #(0.861136)+0.347855 #'(-0.861136); 
lim /(#) = —0.289609#(—0.861136) - 0.95909 #(—0.339981) 

y^x 3 ,4 

- 0.1269115(0.339981) + 0.6674695(0.861136) + 0.6521455'(0.339981); 
lim I(y) = -0.667469 5 (—0.861136) +0.126911 5 (—0.339981) 

y^X 4,4 

+ 0.95909 5(0.339981) + 0.289609 5(0.861136) + 0.652145 5'(-0.339981). 
For the hypersingular cases for p = 2: 

lim I(y) = 0.117272 #(-0.861136) + 0.452036 #(-0.339981) 

y^x 1,4 

+ 2.40115(0.339981) - 10.7095(0.861136) - 0.5991815'(0.861136) 

+ 0.1739275"(0.861136); 

and for p = 3: 

lim I{y) = i [-0.136183 5(-0.861136) -0.752693 5(-0.339981) 

y^x 1,4 

- 9.21452 5(0.339981) - 41.46675(0.861136) - 0.5991815"(0.861136) 
+ 2 (—10.7095 , (0.861138) —0.1739275(0.861136)) 

+ 0.4638065(0.861136)]. 
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Ioakimidis and Theocaris (1977) have developed a Mathematica procedure, called 
PVI, that uses the definition 


f iW <fe = lim 

Ja x-y e— *o 



9(x) 

x-y 


dx + 



9{x) 

x-y 



(5.5.13) 


where £ > 0, and a < y < b, and computes the function qo(y) for the Gauss- 
Legendre, which is given by 



- dx = log 

x-y 


1 - 2 / 

1 + 2 /’ 


-i < y < i; 


(5.5.14) 


it also computes some other complicated cases of Cauchy singular integrals, e.g., 
g{x) = x 171 , g(x) = e ~ x , or g(x) = cosx for [a, 5] = [—1,1]. The latter two 
cases involve the exponential integral Ei(x) and the sine and cosine integrals Si(x) 
and Ci(x). Ashley and Landahl (1985) have studied the case of Mangier-type p.v. 
hypersingular integrals (p = 2). 

Although Mathematica is useful in such research, care must be taken to avoid mis¬ 
leading results. Thus, in the case of Gauss-Chebyshev rule for Cauchy p.v. integrals, 
there is a region of instability near the origin y = 0; also, if we generate the formula 
for the Gauss-Jacobi rule for Cauchy p.v. integrals with w(x) = (i — x) a (l + x)@, 
a, [3 > —1, and [a, b] = [—1,1], more serious problems arise which are related to 
the computation of the auxiliary function qo(y) (see Gautschi and Wimp 1987, where 
these problems are investigated in detail). Mathematica fails to compute qo(y) with 
the Jacobi weight function (according to Ioakimidis and Theocaris). The Mathematica 
package CauchyPrincipalValue .m is sometimes useful for Cauchy p.v. integrals. 
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Fourier Integrals and Transforms 


Some quadrature rules for computing the Fourier integrals and Fourier transform are 
presented. The Fourier and Hartley transforms and discrete Fourier transform are 
discussed, and fast Fourier transform (FFT) and fast Hartley transform (FHT) are 
presented together with computer codes for their evaluation. 


6.1. Fourier Transforms 

We will consider the Fourier integrals of the form 


y nOO nOO 

/= — / du / f(t) coslo(x — t) dt, f E R(— 00 , 00 ), ( 6 . 1 . 1 ) 

^ JO J —00 


where uo is the angular frequency. The inner integral in (6.1.1) with respect to t is 
absolutely and uniformly convergent for all real x and u. If the function / is of 
bounded variation on an interval [a, b\ and if a < x < b, then the integral (6.1.1) 
has the value I = \ [f(x + 0) + f(x — 0)]; but if / is of bounded variation and 
/ E C [a, b], then the integral (6.1.1) has the value I = f(x), and the double integral 
(6.1.1) converges uniformly to f(x) with respect to x in any closed interior subset of 
[a, b\. Assuming that the function / satisfies the Dirichlet’s conditions, that is, 

(i) / has only a finite number of extrema in the interval (a,b); 

(ii) has only a finite number of finite discontinuities in this interval); 

(iii) for each point x G [a, b] the finite limits f{pc+) and f (pc—) exist, the relation 
f(x) = \ [f(x + 0) + f (x — 0)] holds for all x\ and 

( iv ) /a I f( x )\ dx < +°°)> 
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we will take f(x) to be the value of the integral (6.1.1). Then we can define the 
Fourier transform by first considering the Fourier representation of / which is given 
by 


y /‘OG /‘OG 

f(x) = — / f(t) [coscjt cos uot T sin uox sinoit] dtduo 

71 J o .7 — 00 

y /‘QG /*00 

= — / / f(t) cosuo{x — t) dtduo 

71 JO .7 — 00 

-j /‘OG /‘OG 

= — J j f(t) [e^-V + e -M*-t)] 

= — / / dtdu 

2tt J.oo 

i r 00 . i r 00 

/ e tu:x du)—= / f(t)e~ lojt dt. 

7-oc V2^7 -oo 


\/27r J-c 


( 6 . 1 . 2 ) 


This is known as the Fourier complex formula , which leads to the definition of three 
Fourier transform pairs, as follows. Let / G I/ 2 (— oo, oo). Then 

Fourier Complex Transform Pair. Tf{x) = F(o;) of f(x) and its 
inverse are defined as 


f{/(,)}EFM = T r me-™ 

V ^7T J — oo 

/ oo 

-oo 


dt, 


F~'{F{u } )} = f{x) = 


\[ 7 Fk J- 


' duo , 


(6.1.3a) 

(6.1.3b) 


where F G L 2 (— oo, oo), and cj denotes the radial frequency. The factor 1/^/2tt in 
both definitions makes |F(o;) | 2 proportional to the energy density of F at frequency 
cj in the same ratio |/(x )| 2 is proprtional to the energy density at time x. Some 
authors use the definition of F(uo) without this factor and place 1 /(2 tt) with the 

/ oo 

f(t) e ~ 27T2at dt , where a 

-oo 

is the frequency which is related to the radian frequency by oo = 2ira ; this definition 
becomes useful in computation where a is known. The complex Fourier transform 
pairs (6.1.3a,b) are also known as Plancherel theorem. 

Let the delta function 6 a (x ), which has a unit mass at a, be defined by 6 a (x) = 

d f 1 x a 

— H a (x ), where H a (x) is the Heaviside function H a (x) = < ’ Let T a 

dx { 0, x < a. 

denote the translation, and 6 = 6 o = lim n \[o i /n)( x )> where xr 0 i/ n )( x ) is the 
characteristic function of the interval [ 0 , 1/n). 

Example 6.1.1 Some useful complex Fourier transforms are given below. 

1 


6F{6 a {x)} = 
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- 27 i U} = -75= E^L - n ) 

k v Att k 

T\x k e _zcrx } = y/2ivi k 6^ k \cj + a), 

Up- v -^} s S nw ’ 

U E«ne—} = \/27T 5E a n«5( w - U 


?{X[r, S ){x)} = 


F{X[-\,i){x 


e Mh-s)/ 2 s in ((s — r)oj/2) 

\f2n w/2 

e -iu/2 gin^/2) e -“/ 2 . / w \ 

—F=-^— = —7=- sine — , 

vTr w/2 vTr \2tt J 


IT UU V 7r 


2 sino; 2 
-= \ — sine a;, 


F{ E «n e raa: Xl-TT.Tr] (©} = %/2 tt 5E «1 


sin7r(a; — n) 


" n v n 7r(a;-n) 

Fourier Cosine Transform Pair. F c (cj) of f(x) and its inverse are 


defined as 


Fc{f(x)} = F c (w) 


2 r°° 



fit) cos [uot) dt , 


(6.1.4a) 


T 1 {F c (lj)} = f{x) = y - J F c {uo)cos{xuo)dx. 


(6.1.4b) 


Fourier Sine Transform Pair. F s {u) of f(x) and its inverse are defined 


F s {f(x)} = F s (lj) = y~ J f(t)sm(cjt)dt, 




2 r°° 



F s (lj) sin(xcj) dx. 


(6.1.5b) 


Let / and g belong to the class L 2 . Some properties of the complex Fourier transforms 
are: 

(1) T{af(tx + bg(x)}) = aF(uo) + bG(uo) (Linearity); 

(2) F{f(x - a)} = e iuja F(u) (Shifting); 


(3 )F{f(ax)} = —F(u/a) (Scaling); 
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(4) F{e lCLX f(x)} = F(uo + a) (Modulation); 

(5) The convolution (or Faltung) of f(t) and g(t) over (—oo, oo) is defined by 

1 1 

f*9 = ^== f(v)g(x~v)dr]=^== f(x — rj)g(rj) dr). ( 6 . 1 . 6 ) 

V ^tt J— oo y 2 tt J— oo 

Let F(u) and G(u) be the Fourier transforms of f{x) and g(x), respectively. Then 
the inverse Fourier transform of F{u) G(lo) is 


T 1 {F(w)G(w)} = —= / f(v)g( x ~ V) dr), 

V J — oo 


F(w)G(w) doj 


f(~v)g(v)dv- 


Properties of Fourier Sine and Cosine Transforms: 

(1) F c {f(x)} = F c (w), .F 8 {/(a;)} = F s (lo)- 

(2) F c {f(kx)} = ^F c (^), k> 0; 

(3) F s {/(fca;)} = ^M^), k > 0; 

(4) F c {/(fca;) cos 6a;} = J- F c + F c {~j^j ’ k > 0; 

(5) F c {f{kx) sin 6a;} = L jr - F, ^ > k > 

(6) F s {/(fca;) cos 6a;} = L i? s + F s ’ k > 0; 

(7) F{/(F;) sin 6a;} = U _p c ~ F o > k > °- 

Convolution of Fourier Sine and Cosine Transforms. LetF c (cj) 
and G c (cj) be the Fourier cosine transforms of f(x) and g(x), respectively, and let 
F s (cj) and G s (cj) be the Fourier sine transforms of f(x) and g(x), respectively. Then 

1 f°° 

•U 1 Tc(w)G c (w)] = —= / g(r))[f(\x-r]\) +f(x + r])}dr). 

V ^ Jo 

If F s (u;), F c (uo) and G s (cj), G s (uo) are the Fourier sine and cosine transforms of 
f(x) and g(x), respectively, then the following results hold: 

(1) / 0 °° FV) G s (Lo)sinLOxdLO = I / 0 °° g(r))[f(\x - rj\) - f(x + rj)] drj. 
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(2) r G <A) sin wxdw = 1 f 0 °° f(y)[g(\x - g\) - g(x + rj )] dg, 

(3) J 0 °° F s (uo) G s (uo) cos cox duo 

= \ r 9{t) [H(t + x) f(t + x) + H(t - x) f(t - x)\ dt 
= \ r /O [H(t + x) g(t + x) + H(t - x ) g{t - a:)] dt; 

(4) r F <A) dLO = f 0 °° f(g)g(g) dg = / 0 °° F s {u)G s {u) dw. 


6.1.1. Use of Simpson’s Rule. To compute the Fourier transform F(co), 
defined by (6.1.3a), first we rewrite f(t) defined by (6.1.3b) as 

-| POO Hy POO 

f(t) = -= F(uj)e- iuJt du> = J- ${F(uj)e- iuJt }du>. (6.1.7) 
V27T J — oo » Jo 

We use Simpson’s rule to yield 

h P> r N/2 

*V) W 6U t /(0) + 4 E hi-i 

j = 1 

A/2-1 

+ 2 ^ / 2j + / (JV/i) , 

i=i J (6.1.8) 


where tj = j/i, /j = / (tj),h is the step size, and N is even. In the inversion process 
from F(uo) to/ (t) we start with a finite number ofvalues F (uoi) ,F ( 002 ),... ,F(oo n ). 
But the computer time depends on the value of n. In order to minimize computation it 
is always better to use the fewest of these values. But this choice is not simple, because 
choosing (uo n ) too low uses only a small portion of the spectrum and may miss its sig¬ 
nificant portion, while choosing these values too high may pick negligible frequency 
components and waste computation time. The problem of choosing the optimal 
frequency spectrum of an unknown output wavefront is, therefore, difficult. As sug¬ 
gested by Meisel (1968), the solution is to sample less often at higher frequencies, thus 
choosing the sample logarithmically, i.e., using uoq, Kuoq, K 2 uoq, ... , K n uoo, where 
K > 1. Hence, we use an approximation that matches a quadratic to three points 
in every two adjacent intervals, with sampling points of Kuo$, K 2 uoq, ..., K n uoo , 
and require that 



F(uo) duo 


x F (u>o) + y F (Ku>o) + zF ( K 2 u > 0 ) 


must be exact for F(w) = 1, to, lo 2 . This yields the set of simultaneous equations 


x + y + z = to o ( K 2 - l) , 
x + Ky + K 2 z = \ w 0 (K 4 - l) , 
x + K 2 y + K 4 z = § lo 0 (K 6 - l), 
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which are solved to give 

(K 2 -l)(K-2), y=^(k-l)(k + if, 

z =^k( K2 - 1 ) 

Hence, the Simpson’s formula is 

f K "u0 n/2 i 

/ ^ P ( U) ) ~ \ 2 (f2j-2 Ao + f2j-i Ai + f2j A 2 ) , (6.1.9) 

Jojo ^ J = 1 L J 

where 


Al = (A--D^ + lf 

. _ (A 2 - 1) (2A - 1) 


The choice of K is made by taking K 


is known. Note that An = 0 if K = 2. 


, where the maximum frequency 


6.1.2. Uncertainty Principle. The Heisenberg uncertainty principle of 
quantum mechanics states that the product of the uncertainty in position and the 
uncertainty in momentum is always greater than or equal to a particular constant. This 
principle is also true for signal processing. It means that an accurate determination 
of the frequency content of a signal requires a long measuring time, or equivalently, 
a short-duration signal contains a wide range of frequencies. These facts are derived 
from the same inequality that relates the properties of a function f(t) and its Fourier 
transform F(uo). Let At denote the uncertainty in time t and A uj the uncertainty in 
the frequency uj of the signal. Then the uncertainty principle states that At • A uj > \. 
This inequality cannot be improved unless some new definitions of frequency, time 
and uncertainty are introduced. 

The Fourier transform F(uo) defined by (6.1.3a) is also known as the spectral 
function of / with pure harmonics = e luJt as the basis functions for the radian 
frequency uo. The value of F(uo) for a given uo may be regarded as the complex 
amplitude by which the frequency uo is present in the signal /. The oscillation 
impulse which shows up in the time interval [to — h,to + h\, h > 0, but is identically 
zero outside this interval and which has a frequency range [c^o — <5, uoo + <5], where 
6 > 0 is arbitrarily small, does not exist, since the Heisenberg uncertainty principle 


( 6 . 1 . 10 ) 
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where ||/|| 2 = (27 t) _1 \f(t)\ 2 dt. The first factor in (6.1.10) is a measure of the 

‘speed’ of the graph of / over the Gaxis, whereas the second factor is a measure of 
the ‘speed’ of the graph of F over the c^-axis. The inequality (6.1.10) implies that 
the graphs of / and F cannot simultaneously have a single peak at the origin. The 
equality in (6.1.10) holds only for f(t) = e~ ct ^ , c > 0. 

6.1.3. Short Time Fourier Transform. If the signal f(t) is not aperiodic 
function, the Fourier series representation of /(£), which is the sum of sine and 
cosine functions (periodic themselves), will not represent the signal. By artificially 
extending the signal and requiring that / be continuous at the endpoints, we can make 
it periodic, and obtain its Fourier representation and Fourier transform. However, a 
better solution is the windowed or short time Fourier transform (WFT or STFT), 
which provides information about signals simultaneously in both the time domain 
and the frequency domain. We define the WFT by choosing a window function g(t) 
which has a total mass 1, is centered about t = 0 and decays rapidly as \t\ —> oo. 
Consider two different signals /i (t) and fa (t) defined by 


/.(*) - { 0 /w ' 


0 < t < 1, 
otherwise, 


lo) = 


r/ ( 

1 0 , 


m, 


1 < t < 2, 
otherwise, 


or fi(t) = f(t) ui f 2 (t) = f(t) ui (t - |), where 

u T ( t -«) = {„; 


s — T j '2 ^ t ^ s -\- T /2, 

otherwise, 


or, more precisely, define 


f s {t) = f(t)g{t-s) = f(t)u T (t-s) = { ^ S . h T ~ t ~ S + T ’ 

{ 0, otherwise, 

where the parameter T is the time delay. Then the Fourier transform of f s (t) is 

i r°° 

F ( s ’ uj ) = -^= / r{t) e iujt dt 

V 27T J — 00 

1 f°° 

= / f(t)g(t-s)e 

V 27T J — 00 


dt. 


( 6 . 1 . 11 ) 


The transform defined by (6.1.11) is known as the WTF or STFT of the function g(t ). 
A widely used window function, introduced by Gabor (1946), is 

g(t) = Af 0 ,„{t) = —k= e ~ t2/{2a2 \ (6.1.12) 

V z7r 

where cr is a fixed parameter. Then the corresponding WTF of a function / is defined 
by (6.1.11) is also called the Gabor transform. For the above function g the function 
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F(u,s) defined by (6.1.11) represents the complex amplitude by which the pure 
harmonic e luJt is present in / during the short time interval [to -6,to-\-6],6 >0. 

Thus, using the WFT we can chop up the signal f(t) into sections, and then 
analyze each section separately for its frequency data. If / has sharp corners, we 
window the input data in such a manner that the sections converge to zero at the 
endpoints (Kaiser 1994). This windowing setup requires a window function g that 
has far less contribution at the endpoints than in the middle. Hence, the window is 
effective in localizing the signal in time. 


6.2. Interpolatory Rules for Fourier Integrals 


In order to evaluate the Fourier transforms numerically, we can use quadrature rules 
to compute the Fourier integrals for F(lj), F c (uj), and F s (lj), defined by (6.1.3a), 
(6.1.4a), and (6.1.5a), respectively. But these rules are not useful for two reasons: 
(i) They and their error estimates are well known and have been extensively studied, 
and (ii) they all have one basic drawback in that they are obtained by replacing the 
integrands on the entire interval of integration (or any of its part) by an algebraic 
polynomial of low degree. As such they produce good accuracy only if the integrand 
is a smooth function that does not vary rapidly. However, two of the Fourier integrals 
contain integrands which are the product f(t) cos ujt and f(t) sin ujt. If the parameter 
uj (which represents the angular frequency in radians per sec) is large, the integrand 
oscillates rapidly, which results in the value of the integral with admissible error even 
after taking a very large number of points in the quadrature rule even for a slowly 
varying function f(t). This makes the computation very difficult and prone to large 
errors. A similar situation can also arise in the case of the integral for F(uj). We are, 
therefore, obliged to develop new formulas that take into account the large variations 
of uj. This is done by taking such factors as weight functions. 

We will assume that the function / (t) —> 0 as 1 1 \ —> oo so fast that the convergence 
of the integrals J 0 °° \f(t) \ dt or J ^ \f(t) \ dt is assured. For the sake of definiteness 
we also assume that the inequality \f(t)\<A\t\~ 1 ~ £ , £ > 0 holds for large values 

of t. Let [a, b] denote an arbitrary finite interval and let p(pc) GP n . By using repeated 
integration by parts, we obtain 


f 


p{x) e luJb dx = e 


iujb 


ip(b) p'(b) ip"(b) p'"(b) 


UJ 


UJ 


UJ° 


UJ* 


— e 


ip(a) p’(a) ip" (a) p'"(a) 


UJ 


UJ* 


UJ° 


UJ* 


_ e iuj{b+a)/2 


{[■ 


ipib) p'(b ) ip"(b) p"'(b) 


UJ 


UJ* 


UJ° 


UJ 


iuj{b—a)/2 


ip(a) p'(a) ip" (a) p'"(a) 


UJ 


uj* 


UJ° 


UJ* 


0 —iuj{b—a)/2 


( 6 . 2 . 1 ) 
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If we take p(x) as a real polynomial, then equating the real and imaginary parts in 
(6.2.1) we get 


f b 

/ p(pc) cos uoxdx 

J a 

uo(b + a) f r p(b) + p(a) p"(b) + p"(a) 


uo 




;(6 — a) 


p'(b) — p'(a) p'"(b) —p'"(a) 


c jJ* 




cos ■ 


;(6 — a) 


s i n ^( 6 + a ) / \P ( b ) “ P ( a ) P "( b ) “ P"( a ) 


a; 




cos ■ 


— a) 


p'(fe) + p'(a) + p"'(a) 


Cjl) z 




. co(b — a) 
sin- 


( 6 . 2 . 2 ) 


/ PO) si 

J a 


sin cjt dx 


— sin + a ) / r^) + P( a ) P ,, (&) + ^"(a) 


a; 




. uo(b — a) 
sin- 


p'(b)—p'(a) p'" (b) — p'" (a) 


Cjl ) z 




cos 


uo(b — a) 


— cos ■ 


u(b + a) f rp(6) - p(a) p"(6) - p"(a) 


COS 


cj(6 — a ) 


p'(b) + p\a) p" f (b)+p" f (a) 


sm 


cj( 6 — a) 


(6.2.3) 


It is easy to see that the above results hold for any complex polynomial p{pc). 

6.2.1. Spline Interpolatory Rules. This implies an algebraic interpolation 
when a specific interpolating polynomial is constructed for each subinterval, and the 
polynomials are chosen such that at the boundary points of two adjacent subintervals 
the corresponding polynomials and their derivatives up to a certain order possess 
the same values. We will derive the interpolation formulas for the Fourier cosine 
integral F c (uo). We partition the interval [0, oo) into a finite number of subintervals 

at the points 0 = To < %i < ••• < x\~ <_Consider one of these subintervals 

[xk, %k+i\ • Assuming that the function / is sufficiently smooth, on this subinterval 
we will interpolate the function / by an algebraic polynomial. For example, we choose 
the interpolation with respect to the values of the function; thus, on Xk+i] we 
take rtk +1 arbitrarily spaced points Xj,j = 0,1,... , rik, such that Xk < Xq < ... < 
%n k < x k+i, and perform the interpolation with respect to the values / (x^) = 
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by means of a polynomial Pk(x) of degree 

n k 

3=0 


Now, consider an integral of the form (6.1.4a) over the subinterval [xk , Xk+i] , where 
we will ignore the constant factor ^J2 jix for now, and replace the function f(x) on 
this subinterval by the interpolating polynomial Pk(x). Then we get 

r x k +1 px k + 1 nX k + 1 

/ f(t) cos ootdttt / Pk(t) cos ut dt = fj / ^ (t) cos cotdt. 

J x k J x k j_ o J x k 

Summing such equations over all subintervals, we obtain the following approximate 
formula for the Fourier cosine integral: 

rOO 00 n k 

F c {oj) = / f{t) cos cotdt « EE fj k ^ / lj k \t) cos cotdt. (6.2.4) 
Jo k=0J=0 Jx k 

Each integral under the double summation in (6.2.4) can be computed from formula 

( 6 . 2 . 2 ). 

Since = f(x) — Pk(x) denotes the error of interpolation in the subinterval 
[xk, Xk+i] , the total error in (6.2.4) is 


p k(x) = E 


TT k (x) 


~ 0 ( X ~ X j) ( X j) 


P = 


n k (x) = (x- A) ••• {x-x k nk ) , 
f(x) = P k (x) + e k {x). 


E, 


^ rx k+ l 

M = E / \e k (t)\dt, 

k =0 ^ Xk 


which leads to the error estimate 


\E a 


00 px k+ i 

H|<E / \ e k(t)\dt. 

k =0 


(6.2.5) 


Here we assume that the right side of the inequality (6.2.5) has a finite value. This 
value depends on the choice of the points Xk, the numbers rik , the interpolation 

(k) 

points Xj , the behavior of the function /, in particular whether it has derivatives 
of sufficiently large order, and the rate at which these derivatives approach zero as 
t —> oo. Note that the estimate (6.2.5) is in general very complicated and has only 
theoretical value. Some specific cases are given below. 

Case 1. Linear Interpolation. Let the interval [0, oo) be partitioned into 
equal subintervals of length h > 0 by the points Xk = kh , k = 0,1, 2,..., and let 
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the values of the function / at these points be denoted by / (xk) = f(kh) = /&. 
The linear interpolation of / with respect to the values at the two endpoints of the 
subinterval [kh, (fc + 1 )h\ is given by (1.5.1), which represents a trapezoidal type 
rule. If / e C 2 [kh , (k + l)ft], the error E^{x, f) is given by (1.5.2). If we multiply 
both sides of (1.5.2) by cos ujx and integrate over the subinterval [kh, (k + l)ft], we 
get 


r(k- 

Jkh 


(fc+l)/i _ kh X — (k + l)ft ' 

Jfe+1 7 Jk 


h 


h 


: dx 


1 


/fc+i sincj(A: + l)ft — fk sin uokh 


+ ^ (/fe+1 - fk) [cos Uj(k + l)h - cos uh\, 


which leads to 

FJlo) = 


POO 

M = / /(*) 

Jo 


cos cot dt 


1 — cos uoh 
uo 2 h 


fo + 2 /fe cos uokh -\-E c (lo), 


k =1 


(6.2.6a) 


where 


= E 


ffu 




oo 

x f n (kh + rh) cos uo(kh + fh) dr df. 
k =0 


This yields the error bound 

,3 oo 

TcMI < — + 0 < 6* < 1. (6.2.6b) 

fc =0 


Now, since this estimate depends on /", suppose that f" is such that \ f n (x)\ < 

- -—, a > 0, v > 1. Then 

(a + x) v 

oo oo oo 

J2\f"(kh + Th)\ < Bj2( a + kh + Th)~ l/ < Bj2( a + kh )~ 1 '- 

k =0 k =0 k =0 


If h and a are preassigned, the value of the last sum is computed. Another simpler 
but less accurate estimate is obtained if 


rk +1 

L ( 


(a T - ht'j v dt <C (n T kh ) ^ <C 


/ “ 


T - ht'j v dt 5 
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in this case we have 


r 

TcH | < T77 


12 L (to 


1 

1) 


h 1 


(6.2.6c) 


The estimate (6.2.6b) can be used for getting estimates of different types, which are 
useful in certain cases. For example, in the case when / is a monotone or piecewise 
monotone function, we have 


TcM|<yV 0 U/m 


where Vo°{f} denotes the (total) variation of / on the interval [0, 00). For the 
Fourier sine transform we obtain the following result in terms of the values 
of the function / at the points xk = kh , k = 0,1,... ,: 


^ / x 1 / sin ooh\ „ 

f -<“) = * (* - — ) * 


1 — COS 00 h ^ , s 

2-—- / .Jk smookh E s {oo), 

k =1 


oo 2 h 

7 

0 7o 

00 

x f"(kh + Th) sin u(kh + £h) dr dt;. 

k =0 


E,(u)) = h 3 f f [(£-t)U(£-t)-£(1-t)] 
Jo Jo 


(6.2.7a) 


(6.2.7b) 


The error E s (co) is similar to E c (co) except that it differs in the function cos oo(kh-h^h) 
which is replaced by sin oo(kh-h^h). Thus, if the function / G C 2 [0, 00] that decreases 
sufficiently rapidly as x —> 00, we get 

,3 00 

\E s (Lo)\< — Y,\f''( kh + 0h )\’ 0 < 6 < 1, (6.2.7c) 

Z k =0 

\E s {Lo)\<^VS°{f\t)}. (6.2.7d) 

In the case when | f" ui < B{a + x) v , a > 0, v > 1, the error estimate E s (uo) has 
the same bounds as in (6.2.6c). 


For the Fourier complex transform, we have the following representation 
in terms of the values of / at the points x\~ = kh , k = 0, ±1, ±2,...: 


F(u) = j°° f(t) e iht = 2 1 C T° h f; /fc e~ iulkh + E(u), 

J -~ w ( 6 . 2 . 8 a) 

= h 3 f f [(£ - t)U(£ - r) - ^(1 - r)] 

7o Jo 

00 

x /"(fc/i + r/iJe-^+^drdC. (6.2.8b) 

k= — oo 
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Thus, if the function / G C 2 [ 0, oo] that decreases sufficiently rapidly as x —> oo, 
we get the same bounds for E(u) as in (6.2.7c) and (6.2.7d); and in the case when 
I f"(x)\ < B(a + x) v , a > 0 , v > 1 , the error estimate E(u) has the same bounds 
as in (6.2.6c). 

Case 2. Quadratic Interpolation. If we interpolate the function / in 
the interval [kh, (k + 2 )h\ of length 2 h with respect to the values /&, fk+i, and fk +2 
at the points kh, (k-\-l)h, and (k + 2)h with a polynomial P 2 (x) of degree 2, then the 
parabolic interpolation is given by (1.5.3), and the related error by (1.5.5) or (1.5.6). 
If we multiply both sides of (1.5.3) by cos ux, integrate over the interval [xk, 0 ^+ 2 ], 
and sum the result term-by-term over the even values of A:, k = 0,2,4,..., then we 
obtain the following representation of the Fourier cosine transform in terms of the 
values f k ,k = 0,1,...: 


POO 

F c (u) = f(pc) cos coxdx 
Jo 


— a 2 fo + C 2 / 2 /c+i cos(2 k + 1)(3 + 2a2 / 2 /c+i cos 2k(3 + E c , 

fc=o fc=o (6.2.9a) 

where (3 = ooh, CL 2 = h(^ (3~ 2 + ^ /? -2 cos 2(3 — (3~ 3 sin 2/?^, 

C 2 = 4 h(3~ 2 (/3 _1 sin (3 — cos /?) . 

The error, in view of (1.5.6), is given by 

rxk+i 

E c (u)= / e k (x)dx 

J X k 


lx k 

u 

2 


0 Jo 


[(£ - - t) + £(£ - 2)(1 - r) 2 U{ 1 - r) 


- 3 £(£ - 1)(2 - r) 2 ] drd£ L /"' (a; 2 fc + rh) cosw (x 2k + £h). 

k=0 (6.2.9b) 

Let K (£, r) denote the kernel of the integrand in (6.2.9b): 

m, r) = (£ - r) 2 f/(e - r) + £(£ - 2)(1 - r) 2 f/(l - r) - ± £(£ - 1)(2 - r) 2 . 

Then \K(£,r)\ < 1 in the region of integration which is the square {0 <£,t< 2} 
(see Krylov and Skoblya 1977, pp. 180-183). This leads to the error estimate: 


f h) I 


74 pZ pZ ^ 

\E c (w)\<— / / d^dr \f'"{x2k 

Z Jo Jo k =0 

p 2 00 

/ dr N I /'" + rh ) I 

Jo fe =0 

1 r 00 

■h 4 - Jf |/"'(a;) | da; = h 3 V£°{f'(x)}. 


= h 4 
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A less accurate estimate is 

oo 

\E c (u)\ < h A max | f" ( x & + ht) |. (6.2.9c) 

°“*“ 1 k= 0 

Similarly, for the Fourier sine transform we get 

POO 

F s (lo) = / f(x) sin coxdx 

Jo 

oo oo 

— ^2 fo + c 2 / 2 /c+i sin(2A: + 1)/? + 2a2 / 2 /c+i sin 2k(3 + E s (lu), 

k= 0 fc=o (6.2.10a) 

where 62 = ^ Z ^ -2 sin 2Z? + (5 ~ 3 cos 2Z?), and the error estimate is 

given by 

Es{u>) = Y jf jf IT - T ) 2 U£ - T ) + £(£ - U 1 - T ) 2 d - © 

00 

- U(£ “ U 2 “ r ) 2 ] drd £ E /"' Mfc + rh) sinw (x 2 k + £h). 

k=0 ( 6 . 2 . 10 b) 

Hence, the bounds for \E s (lj) \ are the same as in (6.2.9c) and (6.2.10a). 

For the Fourier complex transform, the results are 


U)= f(t)e iht 

J —OO 


= 2a 2 E Lfc e 2lfe/3 + c 2 E hk+ie *(2fe+!)/5 + E(w), 

k = — OO k = — 00 (6.2.11a) 

EM = y / / A “ r)2c/(e - r) + & - 2 )6 - T ) 2 Ui - r ) 

1 00 

--^(C-l)(2-r) 2 ]drdC E f'i^k+rh) e-(*-+^)- 

k= — oo 


which yields the error bounds 

/ oo 

\r(x)\dx = h 3 v < r{f(x)}, 

-00 

00 

I-EM I < h 4 E |L" M + Th)\. 

~ ~ k= — 00 


(6.2.11b) 

(6.2.11c) 
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Case 3. Cubic Interpolation with four Single Points. If we take 
4 points Xk, Xk+i> x k+ 2 , and x^+ 3 , and interpolate / with respect to values at these 
points, then the cubic interpolation of / is given by (1.5.7). We multiply (1.5.7) by 
cos ujx and integrate over the interval [xk,Xk+ 3 \ followed by the summation over 
the values of A: = 0,3,6,..., and we obtain the following representation for the 
Fourier cosine transform: 

pOO 

F c (u) = / f(x) cos cox dx 

Jo 

oo 

= a 3 fo + F! ( c 3 cos3fc ^ - d 3 sin 3 kj3) f 3k+1 

k =0 

OO OO 

+ M (c 3 cos 3kf3 + d 3 sin 3 k(3) f 3k - 1 +2a 3 ^ f 3k cos 3 kf3 + E c (u>), 
k= 1 fc=l (6.2.12a) 

Ec{w) = ¥/ 3 ffe ~ r)3U ^ ~ r) “R(W 2)(£ - 3 )(1 - - r) 

+ 1 ^ - l)(e - 3) (2 - rfU{2 1)(£ - 2)(3 - r) 3 ] 

OO 

x (xsk + tIi) cos cj (t3/c + £h) dr (6.2.12b) 

k=o 


where (3 = uoh, and 


^-(3 2 — (3 4 + (j3 4 — |/3 2 ^cos3 (3 + 13 3 sin 3 (3 


13 —2 (3 6 +[(3 ~^(3 )sin3 (3 — (3 ^ cos 3/3 


3/3 4 — 3/3 2 + 3(^/3 2 — (3 4 ) cos 3/3 — 4/3 3 sin 3/3 


a 3 = h 
b 3 = h 
c 3 = h 

d 3 = h [5/3 -3 + 3 ^ 7 , /3 -2 — /3 -4 j sin 3/3 + 4/3 —3 cos 3/3 
For the Fourier sine transform we have: 

poo 

F s (u) = / f(x) sin cox dx 

Jo 

oo 

= hfo + "F ( c 3 sin3/ F + <4 COS 3fc/3) / 3fe+ i 

fc =0 


+ F] (c 3 sin 3fc/5 - d 3 cos 3k0) f 3k - 1 + 2a 3 ^ f 3k sin 3fc/3 + £ s (u;), 

(6.2.13a) 


fc=i 


fe=i 


E,H =h ^ Jo Jo ^ “ r)3U ^ m ~ 3)(1 “ r)3,7(1 “ r) 


p3 p3 
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+ ~ m - 3)(2 - rfU (2 - r) - 1 £(£ - 1)(£ - 2)(3 - r) 3 ] 

OO 

x /( 4 ) (x 3 /c + rh) sino; ( xs k + £ft) drd^; (6.2.13b) 

fc =0 

and for the Fourier complex transform we have: 


F(oj) = / f(x)e iulx dx = (c 3 -id z ) ^ Lfc+i e ^ 

• / -°° fe=-oo 

OO OO 

(csi ds) /3/c-i e 3/cz/3 + 2a3 /3/c e 3/cz/3 + ^(a;), 

k=—oo k =—00 (6.2.14a) 

= T r r ^ " r)3 ^ - T ) - F(£ - 2)(« - 3)(1 - r) 3 C/(l - r) 

+ - 1)(£ - 3)(2 - rfU{ 2 - r) - 1 £(£ - 1)(£ - 2)(3 - r) 3 ] dr 

OO 

x T f (4) ( X3k + r/l ) e“ iw(3:3fc+5 ' l) . (6.2.14b) 

fc =0 


Case 4. Cubic Interpolation with Two Double Points. If we 
interpolate / over the interval [fcft, (fc + l)ft] at the points x k , and x k +i with respect 
to the values /&, fk+ 1 , f' k , and /^ +1 at these points by using a polynomial of degree 
3, the representation of / is given by (1.5.8), and the related error by (1.5.9). Af¬ 
ter multiplying (1.5.8) by cos uox, integrating over the interval [kh,(k + 1 )h\, and 
summing the results for A: = 0,1, 2,..., we find the following representation for the 
Fourier cosine transform: 

pOO 

E c (u) = / f(x) cos ujxdx 

Jo 

00 00 

= A 1/0 - C 1/0 + 2Ai ^2 f k cos k(3 - 2D X ^ f' k sin kf3 + E c (u), 

k =1 fc=i (6.2.15a) 


where 


A\ = h (l2/5 —4 (1 — cos /?) — 6/? -3 sin 0 ), 

C\ = h — 6/3 -4 + 2/? -3 sin /? + 6/3 -4 sin /?), 

Di = h (4/? -3 — 6/3 -4 sin /? + 2 /? -3 cos /?), 

and the error is given by 

^c(w) = F {[(£ — t )Y(£ — r ) + C 2 (l — r ) 2 [(3 — 2 £)t — ^]} dr 

OO 

x F] ^ <4) + rh ) COSLO ( X3k + > 

k =0 
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where the integrand within the braces takes its maximum value of 1/32, which gives 
the final error estimate as 


i pi pi °° 

TcH| < — •— / / drd^J2\f {4) (Xk + rh)\ 

6 32 J o J 0 

= £jf 

By using the mean-value theorem, this estimate is refined to 
\E c (u>)\ < ^|/ (4) (x k + 6h)\, O<0<1. 


(6.2.15b) 


(6.2.15c) 


Similarly, for the Fourier sine transform, we have 

rOO 

F s (lo) = / f(x) sin cox dx 

Jo 

oo oo 

— Bifo + -Di/o + 2Ai fk sinfc/? + 2Fh f' k cos fc/? + E s (lu), 

k =o fc=o (6.2.16a) 

= T jf jf 1^ - r ) 3C7 ^ - 0 + - r ) 2 [(3 - 2C)r - £] drd£ 

OO 

X / (a:fe + rh) sin a; (x fc + £/i), 

k=0 


where B\ = h (6/? 3 cos/?—12/? 4 sin/?+/? 3 (6+/? 2 )); thus, using the mean-value 
theorem, we get the estimates 


E, 


G /*oo 74 

sM - 192 l l /(4)(a;) l ^ = 192 UUI/^U)}, 


1-FsMI < ^ |/ (4) (x fe + 0ft)|, O<0<1. 


For the Fourier complex transform we have: 

poo 

) e 


/ oo 

/(t) da; 

-OO 


OO 


OO 


= 2 A 1 fke~ ikp ~ 2iD 1 J2 fte-W + Eiu), 


E(u) = 


k= — oo 

h 5 ^ ^ 

T 


k= — oo 


(6.2.16b) 

(6.2.16c) 


(6.2.17a) 


0 ao 


{(£ - t) 3 U(£, - t ) + £ 2 (1 - t ) 2 [(3 - 2 £)t - £] drd£, 


M / (^3fc + rh) 


0 -iuj(x k +£h) 


k =0 
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which gives the error estimates 

h 4 r°° h 4 

TMI ~ 192 j 0 \f i4) W\ dx = i92 ^-°°oo(/'"(*)}, 

TMI < ^|/ (4)( ^ + ^)|, 0<6»<1. 


(6.2.17b) 

(6.2.17c) 


Case 5. Cubic Interpolation with Three Double Points. If we 
interpolate / at the points Xk, £fc+i, and #fc +2 with respect to the values /&, //c+i, 
/£, /fe +1 , Z/c+ 2 , and /^ +2 at these points, the representation of / is given by (1.5.11), 
and the related error by (1.5.12). After multiplying (1.5.11) by cos uox, integrating 
over the interval 0 ^+ 2 ], and summing the results for k = 0, 2,4,..., we find the 
following representation for the Fourier cosine transform: 


pOO 

ErW) = / f(x) 
Jo 


cos cox dx 


— 2 I 2/0 + C 2 ^2 / 2 /c+i cos(2 k + 1 )/? + 2 A 2 cos 2k(3 


k =1 
00 


fc=l 

00 


- D 2 /' - E 2 Y, /L+i sin(2fc + 1)/? - 2F 2 ^ /' fe sin2fc/3 + £? c (w), 

(6.2.18a) 


fc =0 


fc=l 


where 

h 6 uj 6 A 2 = /? (156 — 7/? 2 ) sin /? cos /? + 3 (60 + 17/5 2 ) cos 2 /? — 15 (12 — 5/? 2 ) , 
h 6 uo 6 B 2 = /? (/? 4 + 8/? 2 — 24) + /? (7/? 2 — 156) cos 2 /? + 3 (60 — 17/5 2 ) sin /? cos /?, 
h 6 uo 6 C 2 = 16/? (3 — /? 2 ) sin (3 — 48/? 2 cos /?, 

h b uj 6 D 2 = 2/? (/? 2 — 24) sin (3 cos (3 + 15 (/? 2 — 4) cos 2 (3 + /? 4 + 27/? 2 + 6/?, 

= 16/? (/? 2 - 15) cos/? + 48 (5 - 2/? 2 ) sin/?, 

/i 5 cj 6 F 2 = (3 (5/? 2 - 12) + 15 (4 - /? 2 ) sin (3 cos (3 + 2/? (/? 2 - 24) cos 2 /?, 

and the error is given by 

00 

x T L 4) ^ 2fc + cosa; (6.2.186) 

k=0 

This yields the error estimates 

1,7 00 

T<U)| - 9450 ^o<K 2 (a;fc + 9h) I- (6.2.18c) 
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Similarly, for the Fourier sine transform, we have 

rOO 

E s (uo) = / f(x) sin uoxdx 

Jo 

oo oo 

= B 2 fo + C 2 53 f 2 k+i sin(2 k + 1 )(3 + 2 A 2 53 f' 2k sin 2k(3 

k=1 k=1 

OO OO 

+ ^2/0 + E2 /2/c+i cos ( 2 k + 1 )(3 + 2F2 /2k cos 2 fc/? + F^ C (^), 

fc=o fc=i (6.2.19a) 

= ^ - 2 ? 

00 

x F] / <4) ( X2fc + sin w ( X2fc +m 

fc =0 

which gives the error estimate 

/? 7 00 

MM I - 9450 51 0 “ a <2 l /(4) (x2fe + 6h) I' (6.2.19b) 

fc=0- 


For the Fourier complex transform we have 


/ oo 

/(*)' 

-00 


; dx 


= 2A 2 £ f 2k e- 2ik P + C 2 /Mi' 


,-i(2fc+l)/3 


k= — oo 
00 


k= — oo 
00 


-2iF 2 ^ / 2 fc e~ 2ik P — iE 2 ^ /' fc+r 


-j(2fe+l)/3 


ft 7 


k= — oo 
00 


k= — oo 


THI < 9450 E o<!<2 l /(4) ( * 2fe + I- 

k= — oo 


E(u), 

( 6 . 2 . 20 a) 

( 6 . 2 . 20 b) 


6.2.2. Hurwitz-Zweifel’s Method. Hurwitz and Zweifel (1956) consider 
integrals of the form 


rOO 

S(x) = / 

Jo 

rOO 

C{x) = / 

JO 


f(uo) sm(xu) duo , 
<7 (a;) cos(xc<;) duo, 


( 6 . 2 . 21 a) 

( 6 . 2 . 21 b) 


which appear in applied mathematical problems and need to be computed. Assuming 
that the functions / and g are such that f(—x) = —f(x) and g(—x) = g(x), they 
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use the Gaussian-Chebyshev quadrature (§3.2.7) on the interval to derive an 

approximation formula by performing the sum over half cycles and using standard 
techniques for accelerating the convergence of the sums of an oscillating series. First, 
the range is extended to — oo < x < oo by setting y = xuj/tt — \ in ( 6 . 2 . 21 a) and 
u = xuj/tt in ( 6 . 2 . 21 b), and extending the definition of / and g to f(—x) = —f(x) 
and g(—x) = g(x). Then the integrals (6.2.21 a,b) become 

7T f 1/2 

S(x) = TT j cr(?/, x) cos 7 rydy, ( 6 . 2 . 22 a) 

2x J—i /2 

7T f 1 ' 2 

C(x) = — 7(77 x) cos 7 rudu, ( 6 . 2 . 22 b) 

J-i/2 

where 

oo 

a{y,x)= Y, (-!)"/(“ (v + n + 1 )). 

n= — oo 
oo 

7 (u,x)= H ( u + n ))- 

n= — oo 

The function cr(y,x) has the following properties: (i) cr(y,x) = a(—y,x)\ (ii) 
cr(^x) = cr(— \,x) = 0 ; (iii) a(y + n, x) = (—l) n cr(?/, x); and (iv) cr is regu¬ 
lar in — | < y < | if f(x) is regular in — oo < x < oo. Because of these properties, 
cr can be expanded as a Fourier series of the form 


a(y,x) = E a n (x) cos(2 n + l)7n/ = cos7r?/ E a n cos 2n 7 T 2 /, (6.2.23) 

n=0 n=0 

using the fact that cos n6 is a polynomial in cos 6. A similar expression can be written 
for 7 (u, x). If we substitute (6.2.23) into (6.2.22a), we obtain 

7 r /T/2 oo 

S'(t) = — / cos 2 7 n/a n (x) cos 2n Try. 

2X J -l/2 n =0 

Then a set of polynomials in cos 2 tt?/ orthogonal on the interval (—1/2,1/2) with the 
weight function cos 2 Try is found. Let G n (cos Try) represent these polynomials with 
the orthogonality relation 

, 1/2 

/ cos 2 Try G n (cos Try) Gm(cos Try) dy = 0 for n ^ m. 

7 - 1/2 

Since the polynomials G n (cosTry) are related to the Chebyshev polynomials of the 
first kind T n (x) by G n (cosTry) = cos(7n/) -1 X2 n+ i(cos7n/) = cos(7n/) _1 cos(2n + 
1)7 ry, we obtain the 27V-point Gauss-Chebyshev quadrature formula 



N 

cr(y,x) costt ydy = ^ 
3 =1 




(6.2.24) 
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where the nodes rh N \ which are the zeros of Gat (cos Try), are given by 


„W 


2j — 1 


Vj 2 (27V + 1) ’ 


j = 1,2,... ,7V, 


and the weights A^U are the so-called Christoffel numbers (see §5.1.1). These 
nodes and weights for the 2- and 4-point formulas are: (i) for the 2-point formula 
(TV = 1): yi = 1/6, cos ~yi = \/3/2, Ai = 1/4; and (ii) for the 4-point formula 
(TV = 2): yi = 3/10, y 2 = 1/10, cosTrya = 0.5877852, costt y 2 = 0.9510565, 
Ai = 0.06909832, A 2 = 0.18090169. It is found that the 2-point formula gives 

CT\U X) 

sufficient accuracy. Formula (6.2.24) is exact only if--—- is independent of y. A 


special case of (6.2.24) is f*y 2 x ) cos ' x ydy = \ cr(0, x). 
Since 


cos Try 


f 1/2 2k , i r(fc + i) 
J —i/2 \Z5Fr(fc + i)’ 


the weights ' are the solutions of the N simultaneous equations 


r(fc + ^) 
r(fc + i) 


N 


= 2E 

3 = 1 


cos 2k - 2 (Jfelt x m 


2[27V+1] J 


k = 1,2,... ,7V. 


These weights are already calculated in §5.1.1. 


Example 6.2.1. Consider g(x) = (l + L 2 x 2 ) \ where L is a constant. 
Then the integral (6.2.21b) is evaluated analytically to give C{x) = — where 
x = x/L, and the 27V-point quadrature formula yields 


G*) = AT E 


TT A 2aA 


o r ^ (IV) 

ZX J = 1 COS 7H/j 


{y/ N) ’ x )’ 


(6.2.25) 


where 


oo 


x 2 + i 2 7r 2 + n) 

x silih i: COS7T yj N ^ 


sin" 1 7ry* N) cosh 2 a: + cos 2 7 TJ/P j sinh 2 i 


,W 


7 (yj N \ x ) 

( N ) 

cos Try) 


= 2i{e“ £ - e“ 3£ } [l + (4 cos 2 ttj/U ) - 2) e“ 2£ 


+ 


(6.2.26a) 


(6.2.26b) 
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Thus, (6.2.26b) implies that (6.2.23) converges rapidly for large x, and (6.2.25) and 
(6.2.26b) imply that in the limit C(x) = —r e~ x + O (e~ 3x ) for large x, independent 

JjIj 

of TV, so that even a 1-point formula is useful. But as x decreases, one should go to 
larger values of TV. ■ 

A drawback of this method is that the value of uj at which f(co) or g[yj) is to be 
computed depends on the value of the parameter x. Thus, the method is useful when 
the results are needed only for a few values of x. 

To facilitate computation, define 


rrr _ n~r r OO 

S(x) = - Y S„(x), C(x) = - \ Co(x) + C„(x) 

nr * nr * ^ 


n =0 


n =0 


where 

S„ 


(x) = (-1 ) n J f (y+ n + \)^j cos-Kydy 


'- 1/2 
N AN) 

= (-i) n E J 


j=o cosny- 


(N) 


{'£ c 


,(N) 


- (y) +n + 




+ 


X(- 


c n (x) = (-i y 


1/2 


- 1/2 


'S (“+“)) 


(N) . 

-y) + n - 


tdu 


!))}• 


= (-uE 


N A (JV) 


j=0 COS 7 TU J 


(N) 


{»€ (»r+"))+»£ (-»r+"))}• 


Averaging Technique. As suggested by M. Ray in Hurwitz and Steifel 

n 7r 

(1956), form the sequence of partial sums /3 n = Sk(x),so\hatS(x) = — lim f3 n . 

k =o x n ^°° 

Then find the limit of the sequence {/T n } by the ‘averaging technique’ which is 
achieved by defining 


a l ^ — \ (fin + Pn+l) > 

4”> = 1 («;"’+aS" 1 ’), 

4”’= 5 (“L-’.+oK"), 

for which see Knopp (1928, §114, p. 244). Then lim (3 n = lim a The sequence 

n — >oo k — >oo 

dk generally converges more rapidly than the sequence /3 n . 
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Table 6.2.1. 


n 

/ 

Sn 

0n 

(n) 

a\ 

10 

0.2776371 

0.1388186 

0.0668927 

2.6191(—3) 

11 

0.2570943 

-0.1285472 

-0.0616545 

—1.8693(—3) 

12 

0.2391407 

0.1195704 

0.0579159 

2.0741(—3) 

13 

0.2233671 

-0.1116836 

-0.0537677 

—1.4098(—3) 

14 

0.2094314 

0.1047157 

0.0509480 

1.6853(—3) 

15 

0.1970509 

-0.0985254 

-0.0475774 

—1.0791(—3) 

16 

0.1859931 

0.0929966 

0.0454192 



Table 6.2.2. 


(n) 

n a\ J 


a (n) 

a 3 

4 n) 

of 1 

10 2.6191(—3) 

3.749(—4) 

2.386(—4) 

2.271(—4) 

2.270(—4) 

11 —1.8693(—3) 

1.024(—4) 

2.173(—4) 

2.270(—4) 


12 2.0741(—3) 

3.322(—4) 

2.350(—4) 



13 —1.4098(—3) 

1.378(—4) 

2.204(—4) 



14 1.6853(—3) 

3.031(—4) 




15 —1.0791(—3) 






POO 

Example 6 .2.2. Compute S(x) = — 

Jo 1 


UJ 


- C jO z 


sin (jjxduj, which has the 


7r /yi" \ 

exact value — e~ x . Table 6.2.1 gives the values of f\— (y + n + J in column 2, 

of S n = (—l) n Ai/^— (?/ + n + |) ^ in column 3, of /3 n in column 4, and a ^ in 

column 5 for n = 10(1)16. The values of a(^ are then interpolated in Table 6.2.2 to 
obtain the limit of the sequence , thus implying that we can take S(x) ~ . 

Then we obtain the computed value of S(x) ~ 7.131 x 10 -5 for x = 10, which 
compares very well to the exact value 7.1314 x 10 -5 , where the error introduced by 
the quadrature rule is of the order e~ 2x = e~ 20 = 2 x 10 -9 . ■ 


6.3. Interpolatory Rules by Rational Functions 

The use of interpolating polynomials is not always computationally convenient. In 
this method we need to partition the interval of integration [0, oo) or (—oo, oo) into 
an infinite number of subintervals of finite length. This number depends on the rate 
of decrease of the function / as \x\ —» oo. The faster this rate is, the less the number 
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of the subintervals is. We will combine the Fourier cosine and sine transforms into a 
single integral with the exponential function e 2UJX . Thus, we consider 


F e (u) = / f(x)e LUJX dx , (6.3.1) 

Jo 

where for real-valued / the real and imaginary parts of (6.3.1) represent the Fourier 
cosine and sine transform, respectively. If the function /is such that f(x) = F(x)(l + 
x )~ s , s > 1, and F E C[ 0, oo], then, as in §1.5, we write f(x) = (1 + x)~ s F{x) = 
(1 + x)~ s [P n (x) + e n (x)\, where P n (x) has the representation (1.5.13). This gives 
the representation for F(uo) as 


F{uj)= / e 2u;x (l + x) s [P n (x) + e n (x)} dx 

Jo 

n n «oo 

= J2 F (*fe) E A fem / eiu;a: (!+ x ) _r 


/c=0 m=0 


’ dx + R n {(jS ), 


R n (oj) = / (1 + a;) s e n (x)da;, 

Jo 

.a. _Jk)0 + x k) n A _. -.. 


(6.3.2) 

(6.3.3) 


where Akm = c™ —77 depend only on the points x k and not on 5 or F. The 

t r' (x fe ) 

integrals J 0 °° e za;a: (1 + x) _n+m_s dx depend only on uj and 5, which depends on 
how fast f {pc) decreases as x increases without bound. The rules for computing these 
integrals are given below in §6.3.2. An estimate for the remainder (6.3.3) in terms of 
the interpolation error e n (x) is given by 


,)i < r 

Jo 


(1 + x) 


(6.3.4) 


If, for all sufficiently large values of n, the interpolation error e n (x) is such that 
\e n {x)\ < M < oo for 0 < x < oo, then the remainder R n {uo) tends to zero 
uniformly with respect to uo on the axis — oo <cj<ooasn^oo (Krylov and 
Skoblya, 1977, pp. 213-214). 

6.3.1. Equally Spaced Interpolation Points. Let the points x k be 
equally spaced such that x k = kh , k = 0,1,..., and h > 0. Then 7r n+ i(T) = 
x(x — h)... (x — nh ), and the coefficients in A km are computed from 


-= x(x — h) ... [x — (k — 1 )h\ [x — (k + 1 )h\ ... (x — nh) 

x - x k 

n 

= ^ ^rn (1 + T) m , k = 0,1,... , n, (6.3.5) 

m =0 
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In the case of uniform convergence, we have 

tt' (x k ) = kh(k - 1 )h... h(-h)(-2h) ... (-1 )(n - k)h 
= h n (—l) n ~ k k\ (n — k)\, 


which yields 


Akm — 


cff (1 + kh) n 

( —1 )n-k fan R _ | 


(6.3.6) 


While computing the tables for the values of A^m, we assume h = 1, since any other 
value of h leads to 1 through linear transformation x = hx f . Note that the tables of 
values of A^m (k,m = 0,1,... , n) for n = 1 (1) 15 and h = 1 to 10S are available 
in Krylov and Kruglikova 1968). 

For equally spaced interpolation points the representation (6.3.2) becomes 


Ti Ti nOO 

= Y Hkh) Y (1 + x)~ n+m ~ s dx + R n (u). 

k= o rn=o Jo (6.3.7) 


6.3.2. Computation of the Integrals J 0 °° e LUJX (1 + x) m v dx = 
where m > 0 is an integer and 0 < v < 1. We use integration by parts: 


d-m-\-v — 


rOO 

/ e iujx (l + x)- 

J o 


' dx 


(m - 1 + v)(l + x) 771 - 1 ^ 
1 iuo 


m — 1 + v rn — 

which gives the recurrence formula 

1 


iuo r 
1 + V o 


00 IUO 

H- 

o m — 

00 e iujx dx 


iuo r 

1 + V o 


00 e iujx dx 

o (1 + x) m - 1+ ^ 


(1 + x) 


m— l+i/ ’ 


dm+v — 




m — 1 + ^ m — 1 + ^ 


U+y-1 • 


(6.3.8) 


Now, we will consider the integral I v for 0 < v < 1. If we set 1 + x = t, we get 
4/ = e~ luJ f^° e %ut t~ v dt. For v = 1 we have 


h=e 


cos uot 1 f c 

l — dt+t L 


r 00 cos uot 1 f 00 sin uot 1 N , % 

- dt+t I —;—dt = —e [Ci (a;) + t Si (a;)] , (6.3.9) 
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where Ci(cj) and Si(cc) are the cosine and sine integrals, respectively. ForO < v < 1, 
we obtain 


Thus, 


dt 

t v Jn t v 


r **%= r **%-1 

J 1 t" Jo Jo 

f 


Jujt 


e iLot< ^ =uj v - 1 T{l-v)e i7t{1 -^/ 2 , lo > 0, 


fh 1 71 OO / • \ L /»1 oo 

/ = / t k -'dt = Y 

J« *- & fc! Jo h 


(iu) h 


j^(k + l-v)k\' 


Iu = 


f 


dt 


(1 + x) 1 


= w" 1 T(1 — v) e 

-iu> Y' (^ ) fc 

^ (k + 1 


z ( 7 r(l — v)/2— a ;) 


fe =0 


(fc + 1 — ^) fc! ’ 


(6.3.10) 


6.3.3. High-Precision Formulas. If f(x) = (1 + t) s F{x), s > 1, then 

F c (o;) = f f(x)cosiuxdx= f ^osujx F(x)dx. 

Jo Jo (1 + t) s 


With the weight function ic(t) = (1 + t) s cosccx, we construct a quadrature 
formula of the form 


/■•OO ^ 

/ /iTX dx ~F AkF ( Xfc ) • (6.3.11) 

fe=1 

There are 2n parameters and T&, and we choose them such that (6.3.11) becomes 
exact when F(pc) is a polynomial of degree 2 n — 1 in (1 + t) _ 1 , which implies that 
for 2 n simple fractions (1 + x)~A j = 0,1 ,... , 2 n — 1, we must have 



n 

cos cox dx = E (1 + Xk) J 

k=l 


(6.3.12) 


These equations form a system of 2 n equations, which is linear in Ak and nonlinear 
in and determines the parameters A k and x k . The defect with this approach is that 
even for small values of n the points x k are found to lie outside the interval [0, oo). 
This is because of the varying sign property of the weight function w(pc). Thus, to 
avoid this defect, we must make the weight function to have a constant sign. This is 
done by writing 

rOO nOO nOO 

/ cos coxf(x)dx= / (1 + cos uox)f(x)dx— / f{x)dx = I^—I 

Jo Jo Jo 
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If we set ujx = u, uj > 1 in l\ , then 


1 (u \ 

//= / (1 + cos u)—f( — )du= / (1 + cos x)X(x)dx, 

Jo LO \u J J Q 


where X(x) = — f(—\ Suppose that X(x) is represented as X(x) 
uj \aJ 

s > 1. Then 


1} = 


\ v/ \ 7 Z 00 1 + COST w . 7 

/ (1 + cost) a (t) ax = / -- —Fix) ax, 

Jo Jo (l + ^) s 


(1 + x) s ’ 
(6.3.13) 


which has the positive weight 1 + cos x or (1 + cos x)( 1 + x) _s . Next, the integral 
Jr is reduced an integral with the Jacobi weight function with parameters 0 and s — 2, 
by setting x = (1 — f)/(l + t ): 


% = L ,(x)dx = L + 

(6.3.14) 

which can be easily computed. 

n 

Also, since l\ = / 0 °°(1 + cos x)X(x)dx « A k X (x k ), we choose the 

k =l 

parameters A k and x k such that the this rule is exact for functions (1 + x) - , s > 0, 

2n—1 

j = 0,1,... , 2n — 1, or for all functions of the form (1 + x) c fe (1 +x) k = 


k =0 

(1 + x)~ s ~ 2n+1 P 2n -i(x), where P 2n - 1 € V 2 n-i- This gives 


f°° 1 -f COS X „ , . , A r, „ 

/ n I r t2n-l+ S p 2n-l (x) dx = ^B k P 2n -l (x k ) , 

Jo (L + X > k =i (6.3.15) 


Bh = 


(1 + Xfc) 


2n—1+s ’ 


Thus, the problem of computing the parameters B k and x k on the interval [0, oo) 
reduces to that of constructing a quadrature rule of highest precision with the positive 
weight function (1 + cost)(1 + x)~ 2n+1 ~ s . This leads to the product quadrature 
formula for the integral l\ , which is obtained by setting l/(l + x) = t, x = 1/t — l, 
0 < t < 1 in (6.3.13); thus, 


/ 


//= / (1 + cos x)t s 2 F*(t)dt 


3 = 1 


F* (i fe ) = Q* n (F*), (6-3.16) 


where F*(t) = F(l/t — 1) = F(x), and t k = 1/ (1 + x k ). This formula is exact if 
F*(t)=P 2n . 1 (t). 
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6.4. Trigonometric Integrals 

We discuss trigonometric integrals of the form J ^ f{x) e 2/3x dx, (3 real (or complex), 
which involve a special case of the Fourier coefficients when a period of the trigono¬ 
metric functions coincides with the interval of integration, i.e., when (3 = 27m/ (b—a), 
where n is an integer. The trigonometric integrals are special cases of the integral 
f(x) e@ x dx. We will study the following two cases: (i) f{x) is a real function of 
a real variable x, and (ii) f {x) is well behaved on the interval [a, b\ and determine 
quadrature rules which involve nodes on the real axis. Note that in this section we do 
not consider Fourier transforms of the form J a °° f(x) e 2/3x dx or f(x) e 2/3x dx. 

We use the following notation and definitions which resemble the ones used in 
Fourier theory: A periodic extension f(x) of f(x) with respect to the interval of 
integration [0,1] is defined by 

'f(x)=f(x), a: €[0,1], 

< /(l) =/(0) = I [/(!) +/(0)], 

, f(x + 1) = f(x) for all x. 

Thus, f(x) has some kind of discontinuity at integer values of x when / is well 
behaved. Next, we will write 

C ™/ = f f{x) cos27rkxdx, f = f f(x) sin27rkxdx, (6.4.1) 

Jo Jo 

which are known as Fourier coefficients. Then the Fourier series for f(x) can be 
expressed as 


f(x) = Iq (/) + 2 |f cos 27 vkx + S^ f cos 2 irkx^ 

k=1 


= £ (cWf + iSWf)e 


— ‘I'Klkx 


dx. 


(6.4.2) 


k= — oo 

Some useful formulas are: (i) The Fourier coefficient has the asymptotic expansion 

/'(!)-/'(0) / (3) (l)-/ (3) (0) 


C {k) f = 


{2iiky 


(2ivk) 4 


(6.4.3) 


which usually diverges but may converge to some value other than C^f. If /'(l) ^ 
/'(0), we must use good numerical approximations to /'(l) and /'(0) for very large 
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k. Also, if /(1) = (0) for l = 0,1,... , n — 2, then f + i f = 

O (& _n+1 ), and the Fourier series (6.4.2) converges faster than the usual case, and 
we say that the function / £ oo, oo), which implies that / is ‘nearly’ 

periodic. In the case when / is periodic, the functions f(x) and f(x — 1) coincide 
and /^(l) = /(°)(1) = 0 for all 1. We denote the m-panel trapezoidal rule on the 
interval [0,1] by 


1 m 

T K 1] (/ ) = _ 

m 

3=0 

1 r m- 1 

= — |/(°) + E + i /(i) 

m L j=i 

and the Poisson summation formula is 

oo 

T [m ’ 11 / = 4 1 (/) + 2^U fem) /. 

k =1 


(6.4.4) 


(6.4.5) 


6.4.1. Basic Interpolatory Formulas. Consider the interpolation function 
G(x) such that 

either G(j/m ) = g(j/m ), j = 0,1,... , m, (6.4.6a) 

or G(j/m) = g(j/m), j = 0, (6.4.6b) 

and approximate functionals involving g(x) by exact evaluation of the same functional 
involving G(x). There are three different types of interpolation functions: 

Type 1. Trigonometric Interpolation. Let G(x) £ Vm/ 2-1 with an 
additional cosine term: 


m/2 m/2 

G(x) = 2 jik cos 2 irkx + sin 2 irkx. 

k =0 fc=l 

The function G(t) of this form that satisfies (6.4.6b) has coefficients 
/i k = ( g{x) cos 27 vkx ), 

and the Fourier coefficients of (6.4.7) are 


C {k) g = C {k) g = I 


fi k , k = 0,1,... , m/2 - 1, 

\ Mm/ 2 , k = m/2, 

0, k > m/2. 


(6.4.7) 


(6.4.8) 


(6.4.9) 
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Type 2. Periodic-Type Interpolation. If we choose linear splines 
Gn(x) satisfying (6.4.6b), we obtain the Fourier coefficients 


CWg = C^G n = T{k/m) T I™’ 1 ! (g(x) cos 2irkx ), 


(6.4.10) 


/7 ( sin7rA:m\ 2 

T{k/m) = {-^r) • 


where r(z) is known as an attenuation factor. In the case of higher order peri¬ 
odic splines the Fourier coefficients are of the same form as (6.4.10) with different 
attenuation factors. The results are the same for interpolations is the ‘periodic type’; 
For a periodic function, G(x) is the same function of g(j/m ) as G(x + 1/m) is of 
g((j + 1 )/m) for 0, ±1, ±2 ,.... 

Type 3. Local Periodic Interpolation. The interpolation function is a 
piecewise continuous interpolating polynomial of degree d, where m/d is an integer. 
It has m/d independent interpolating polynomials. The resulting formulas are known 
as Filon-Luke formulas (§6.6.7; also see §3.7 for Filon’s formula). However, for 
d = 1, the interpolating function is the linear spline and the Fourier coefficient is 
given by (6.4.10). This rule is sometimes known as the Filon Trapezoidal rule. 

6.4.2. Euler Expansion. The Euler expansion of f(x) G T n -i is 


f(x) = H n _! + g n {x), (6.4.11) 

'Gi 1 t / \ 

H n _ 1 {x) = Y J \^Y L (6-4.12,) 

\ = f {q ~ 1) O)-f {q ~ 1 \0), (6.4.13) 


where B q (x) is the Bernoulli polynomial of degree q, and g n (x) is not periodic, but 
it has a rapidly convergent Fourier series. This expansion is generally divergent, but 
if operated on both sides with the trapezoidal rule operators, we obtain the Euler- 
Maclaurin asymptotic expansion (2.2.8) which is used as a theoretical basis for the 
Romberg integration. An useful property of g n (x) is 

g«\l)-g^(0) = 0, 1 = 0,1,... ,n — 2. 

From (6.4.11) we obtain the formula 

f f(x)e^ x dx= ( FL n _\e^ x dx+ f g n (x)e^ x dx. (6.4.14) 

Jo Jo Jo 


But since (3 = 2iirl in the case of the Fourier coefficients, and since 


l 


l 



q,i> o, 
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we have 


pi n 1 a 

/ f{x) e 2Mx dx = Jl + / g n (x) e 2Mx dx, (6.4.15) 

Jo (2iriq) 1 J 0 

the real part of which is (6.4.3). Using the m-point trapezoidal rule, the above integral 
(6.4.15) yields 


CWf + iSMf = tio 


n— 1 \ 


1 


A 1 


2 Mm/2 {mm) 


"A \ 

<7=1 (2 tt il) q ' 


1 < l < m/2, 
l = m/2, 
l > m/2, 


(6.4.16) 


where 

W +i^=T[ m > 1 ]( 5 „(a:)e 2 ’ rite ). 

Formula (6.4.16) gives the exact Fourier coefficients of F{x) = H n -\ {x) J rG^ n \x), 
where G^ (x) is the trigonometric interpolation function of g n (x) defined by (6.4.7). 
Note that the first relation in (6.4.16) is known as the Euler-Maclaurin quadratic 
rule. Formula (6.4.16) is exact for / £ V n -\ for any value of m. If f{pc) is 
a trigonometric polynomial of degree m/2 — 1 or less, we have H n _ 1 (x) = 0, 
G(x) = g n (x) = f(x), and formulas (6.4.16) are exact. The theory is redundant 
whenever f(x) £ C°°[— oo, oo] and H n -\{x) = 0. The function H n -\(x) in for¬ 
mulas (6.4.16) may be replaced by any polynomial function, but the final values of 
Hi and vi for l near m/2 provide a criterion for accuracy in all approximations. 

Let (j)d (t; /;to,ti,... , td) or (j>d{x\ /; t) (or simply (j){pc) if there is no confusion) 
denote the polynomial of degree d which interpolates f(x) at x = to, t \,... , t^. Set 

f = [f(to),f(ti),... ,f(td)} T , 


and let 


a = 


0(0), 


<n o) 

2 ! 


A£o)' 

d! 


denote the Taylor’s coefficients of the interpolating polynomial (j){x). Then 


f = V a, V jtk =t^ 


(6.4.17) 
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where V is a Vandermonde matrix. The set of derivatives ( x ) are then obtained 

by solving Eqs (6.4.17). This yields the quadrature rule 


Q(3 


m\ n\ t^; 



(6.4.18) 


which for /? = 2iril leads to formula (6.4.16). 

Giunta and Murli (1987) consider the Fourier coefficients for a smooth function 
f {pc) on the interval [a, b \: 


££/) = 
S ik) (f) = 


b — a 


b — a 


f 2 k7r{x - a) 

/ f{x) cos —-- 

Ja b-a 

f b ,, . . 2 kir(x - a) 

/ f(x) si" 

J a 


b — a 


dx, 


(6.4.19) 


and use the Lyness’s algorithm as follows. For / £ C^ [a, b], the early terms in the 
Euler expansion are f(x) = h n -\{x) + g n (x), where h n -\{x) £ V n -\ is defined by 


n— 1 

K-\(x) = ^2 
9=1 




x — a 
b — a 


(6.4.20) 


where X q = [f( q ^ ( b ) — f( q ^ (a)] (b — a) q 1 , and B q {x) are the Bernoulli poly¬ 
nomials. Then 


C w (f)=C^h n - 1 +C^g n , S^(f)=S^h n - 1 + S^g n , (6.4.21) 


with 


C°> = S(°) h n —i = 0, 


k> o, 

q =2 


(27rfc)^ 


fe n - 1 = 2yj o ( ~ 1 ) ( ! +1)/2 A l 

«=i 


(27rk) q 


q "> 


where the superscript E or O restricts the values to even or odd values of the summation 
index. The Fourier coefficients of g n , (/) and S^ (/) are approximated by / 1 ™ 
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and v™, respectively, where 


Vo = 


— A™’ 1 ' (9n): 


b — a 

2 


Mr = T x m,1] (an cos 2k ^ X _ a ^ ), k < m/2, 


b — a 

m _ 1 

b-a 
2 


ri"*’ 11 f <?„ cos m7r(x ~ a) 

b — a 


(6.4.22) 


*4 = 


4 ro,1] (. 


’ J £n Sin 


2 kiv(x — a) 


” b-a x b-a 

Vk = v k = o. k > m !% 


^, k < m/2, 


and t]; 771 ’ 1 ^ denotes the m-panel trapezoidal rule on the interval [a, b ]. A Fortran pro¬ 
gram FORCO containing subroutines is provided to implement an automatic version 
of the Lyness’s algorithm. 


6.5. Finite Fourier Transforms 


When the domain of the physical problem is finite, it is generally not convenient to 
use the transforms with an infinite range of integration. In many cases finite Fourier 
transform can be used with advantage. We define 


F«(n) = f f(x) si 
Jo 


( tittx \ _ 
sin - ax 


to \ a J 

as the finite Fourier sine transform of f(x). The function f(x) is then given by 


(6.5.1) 


/(*) = -]T F,(„) sin (!//) 


Similarly, the finite Fourier cosine transform is defined by 

/ TiTTX \ 


Fc(n) = [ f(x) 
Jo 


cos I 


\ a 


-) 


dx, 


and its inverse by 




(6.5.2) 


(6.5.3) 


(6.5.4) 


Example 6.5.1. Consider the Laplace equation in the rectangle {0 < x < 
a, 0 < y < b} 

^xx 4” ^yy O 5 (6.5.5) 
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with the boundary conditions x/(0, y) = u(a, y) = u(x, b) = 0 and u(x, 0) = f(x). 
After applying the finite Fourier sine transform to u(x, y) with respect to x from 0 to 
a, we have 


(U s ) xx ( n ) = / u xx sin T ^~ dx 


— [w(0,2/) - (-l)"u(a,2/)] 


(6.5.6) 


U s (n). 


Then Eq (6.5.5) becomes ^- — U s (n , y) = 0. Solving for Z7 s (n, y), we 

get U s (n, y) = Ae n7vy / a + Be~ n7vy / a . Since Z7 s (n, 6) = 0, we can express Z7 s (n, ?/) 


t/ s (n,y) = ^e n7r< ' v ~ b ^ a - e -™(v-b)/*^ . 


After applying the boundary condition at y = 0, we get 


(e-™ b/a - e ™ b/a ^ = /„( 


which, after solving for A n and substituting its value into U s (n,y), yields U s (n, y) 
sinh[n7r(v — b)/a] , . x 

- si l,h(nV) ^ ^ 


, . 2 sinh[mr(6 — y)/a] „ , , . , 

y ) = - -r-r^— , , x fs (n) sin {mix a), 

a ^ sinh(n7ro/a) 


where 


fs(n) = [ /(£) sin(n 7 r£/a)c?£. 

Jo 


Example 6.5.2. Solve the wave equation u u = c 2 u xx , 0 < x < Z, subject 
to the conditions u( 0, £) = g(t) and u(l,t) = 0 for 0 < t < Z, and xx(t, 0) = 0 
for t > 0. Taking the finite Fourier sine transform with respect to x and using the 
boundary conditions at x = 0, Z, and (6.5.6), we get 


Cl U s TITTC Tr rmc , x 


The general solution of this equation is 


, s n7rct . n7rct rr 

Z7 s (n) = A cos — - b B sin — - b U SiP (n), 
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where U s ^ p (n) is the particular solution which can be obtained by the method of 
variation of parameters as 


U 3 , p {n) =c g(r) 
Jo 


z(t - t) 


sm---- dt = c , „.. . ,_ 

o l Jo 1 


[ 9(t-r) 

Jo 


U'KCT 

— r ) sm —-— dr. 


With this choice of U SjP (n), the constants A and B become zero because of the initial 
condition C7 s (n, 0) = 0. Hence, U s (n) = U s ^ p (n). Thus, by (6.5.2) 


, x 2c . T17TX 

(xA) = -r 2^ sm ~T / s(t-r) 

1 n =l 1 Jo 


nircT 

— r ) sm —-— dr. i 


l 


Note that the finite cosine transforms for the derivatives of a function u can be obtained 
analogous to (6.5.6). 

Example 6.5.3. By using both Laplace and Fourier transforms, we will solve 
the boundary value problem 

Utt — c 2 u xx = sin u(x, 0 ) = 0, Ut(x, 0 ) = 

Note that this equation in the Laplace transform domain is 

3 -M 


s 2 u(x 1 s) - c z u xx (x,s) = 


,2 — 


2 + s 2 


1 + s 2 


Applying the complex Fourier transform, we get 


2 + s 2 2 1 


( CV + S2 ) U ^ X ’ S) = TTs 2 V 7T TTw2 ‘ 


Thus, 


U(x,s) = 


2 + s 2 

1 + S 2 V 7T (1 + LO 2 ) (c 2 L 0 2 + S 2 ) 


2 + s 2 


(1 + 5 2 ) (s 2 - c 2 ) V 7r 

On inverting the Fourier transform, we have 

2 + s 2 


1 + uS 2 c 2 uo 2 + s 2 


u(x, s) = 


(1 + s 2 ) (s 2 — c 2 ) 

1 1 


-M _ _ p -s\x\/c) 


= <B 


1 


D -M 


s — c s cJ (1 + c 2 ) (1 + s 2 ) 

' + _ cs 

cs \s — c s + c) (1 + c 2 ) (1 + s 2 ) 


0 -s\x\/c 
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where B = 


2c (1 + c 2 ) 


. After taking the Laplace inverse, we find that 


i(x, t) = B (e ct — e ct ) — — 


sin t 


o~\x\ 


+ H(cb— | t |) 


- -B (e ct ~\ x \ +e- ct+|a: 0- 


LC 


1+C 2 


cos (t — \x\/c) 


6.6. Discrete Fourier Transforms 


The k -th coefficient c k of a complex Fourier series for a function g of period P is 
given by 



27T ikx/P 


which, by using Riemann sum method, can be approximated by 


Ck 


1 

P 


iV-l p 

E^) e~ 27Tikx ^ p — 

3=0 


1 

N 



e -2irijk/N 


( 6 . 6 . 1 ) 


where x 3 = j(P/N) denotes the left endpoint of the 7 -th subinterval for j = 
0,1,... ,1V — 1. Thus, given N complex numbers, {/j} J=0 \ their IV-point dis¬ 
crete Fourier transform (DFT), denoted by {i^}, is given by 


N—l 

F k =J2fj e~ 2 ^ ijk/N ( 6 . 6 . 2 ) 

3=0 

for all integers k = 0,=bl,=b2,.... Note that it is a normal convention to use a 
lower-case letter for a given finite sequence of numbers and an upper-case version of 
the same letter for its DFT. As an example, let /j = e ja , for j = 0,1,... , N — 1, 

1 - e aN 

and a a constant. Then its IV-point DFT is given by Fk = -- - a - 2 irik/N * 

DFT is useful for approximating the coefficients c&. Formula (6.6.1) leads to the fast 
Fourier transform (FFT) which, by grouping terms in (6.6.1), reduces the computation 
considerably. 

Suppose the sequence has IV-point DFT {Fk} and {g 3 }^_^ has IV- 

point DFT {G/c}. Then the basis properties of the DFT are: 

(i) Linearity. For all complex numbers a and 6 , the sequence {afj + bgj}^_^ 
has IV-point DFT {aF k + bG k }- 

(ii) Periodicity. For all integers k we have F k+N = F k . 
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(iii) Inversion. For j = 0,1,... , TV — 1, we have 

f 3 =^ N ii F k^ ijk/N . 

k=0 

The relationship between (6.6.2) and (6.6.3) can be expressed as 

Fk ^ fj , 


(6.6.3) 


(6.6.4) 


where the sequence is the DFT of the sequence {F k } k= Q. Functions 

related to each other by an integral Fourier transform will also be connected by 
the double-headed arrow, such that the function on the right is the Fourier integral 
transform of the one on the left. The sequence appearing on the right in (6.6.4) is 
usually a function of frequency and is known as the DFT of the sequence on the left, 
which is usually a function of time, space, or simply a sequential index and is known 
as the Fourier series or the inverse discrete Fourier transform (IDFT) of the sequence 
on the right, or sometimes simply as ‘data’. An important property is that the indices 
of F k < —> fj are interpreted modulo TV; however, F_ k for 0 < k < TV — 1 is 
understood to mean F^_ k . Other useful definitions and properties are as follows. 

(i) A sequence is even if F k = F-k, and odd if F k = —F_ k . A sequence is 
conjugate even or conjugate odd if F k = Ff k or F k = —F k , where the asterisk 
denotes the complex conjugate. A sequence is even or odd iff fj is even or odd, 
respectively, i.e., F_ k <—» /_j. 

(ii) F k <—» f*j, and Ff k , <—» fj. Thus, F k is real or imaginary iff fj is 
conjugate even or conjugate odd, respectively, i.e., fj = ±/* Moreover, fj is real 
or imaginary iff F k is even or old, respectively, i.e., F k = ±Ff k . 

(iii) F k is real and even iff fj is real and even; F k is real and odd iff fj is imaginary 
and odd; F k is imaginary and even iff fj is imaginary and even; F k is imaginary and 
even iff fj is real and odd. 

Let W denote either e~ 27Tl ^ N or e 27Tl / N . In either case we have W = 1. Thus, 
by periodicity, every DFT {F k } satisfies F N _ k = F_ k , and the Parseval’s equality 
holds, i.e., 

N—l N—l 

Eiu 2 = v Ei^i 2 - ( 6 - 6 - 5 ) 

j=0 k=0 

The approximation in (6.6.1) needs some interpretation. Since the right side of (6.6.1) 
is 1 /TV times the DFT of {g( jP/N) it has period TV in the variable k. The left 
side of (6.6.1) is c k , which does not have period TV. Thus, to ensure that the sum 
(6.6.1) is valid we will assume that |fc| < TV/8. 

In view of the approximation (6.6.1), we can write the M -th partial sum Sm of 
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the Fourier series of a function g of period P as 


S M (x )* £ — Gk e 27rikx / p , 


(6.6.6) 


where {G k } is the Appoint DFT of the sequence {g (jP/N) Substituting the 

sampling points { jP/N}^_^ for x into (6.6.6), we obtain 

•p i M 

a? £ 


^VA/V N ^ * 

k= — M 

This formula can be expressed as an TV-point (inverse) DFT with weight IVn 
e 2 in/N> w j 1 j c ] 1 [ s the TV-th complex root of unity, if we use Gn-u = G - k : 




If we define 


1 

' TV 

V Gfc + 

1 

TV 


■ k Wx 


fe=0 


k=l 


1 

' TV 

M 

e G& + 

1 

TV 

M 

E G a 

T-k hf 


k=0 


k=l 


1 

' TV 

M 

Y Gk W N + 

1 

TV 

N—l 

E 



fe=0 


k=N — A 

f 

G fe 

for k = 0,1,. 

• • ? 

M, 


0 

for k = M + 

i,. 

..,N~ 

- M -\ 

Gk 

for k = N m ,. 


,N U 



rj(N-k) 


then we have 


* P i 


(6.6.7) 


( 6 . 6 . 8 ) 


which expresses the Fourier series partial sum values { Sm{ j P / N)}^ = ^ as the Ap¬ 
point DFT of {Fk} with weight Wn = e 27rZ//Ar , multiplied by 1/N. 

6 .6.1. Discrete Sine and Cosine Transforms. Using the definitions 
in §6.1, the k -th sine coefficient B k of a real-valued function g over the interval 

2 kirx 

[0, L\ is defined by B k = — f 0 g(x) sin —— dx, and the k -th cosine coefficient 

Jj 

2 kirx 

A k by A k = — / 0 g(x) cos —— dx. The discrete sine transform are obtained by 
1j Li 

approximating the integral for B k by a uniform Riemann sum: 


„ 2 U 1 (JL\ . knjL/N L 2 ^ (J L 

BkK r, Ey sm —^N = N EAv 


jL\ . knjL/N 
_j sm——. (6.6.9) 
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Similarly, we have 


Ak 


N- 

E 


jL 

N 


kirjL/N 

L 


( 6 . 6 . 10 ) 


Hence, for areal sequence {fj}^_Q the discrete sine transform (DST), {F^}, is 
defined by 


N—l 


Ft 


= E/, 

3 = 1 


sin ■ 


7T jk 


and the discrete cosine transform (DCT), {F{f}, by 


A—1 


Ft 


= E/: 

3 = 1 


irjk 


7 cos —— 
3 N 


The approximations (6.6.9) and (6.6.10) are valid only for k <C n. Hence, we will 
henceforth assume that k < n/ 4. 

If Sm(x) denotes the M- harmonic partial sum of the Fourier sine series, then 


M 

Sm{x) = B k 
k=1 


kirx 


where B & are defined by (6.6.9). Assuming that M < 1V/4, we obtain the approxi¬ 
mation 

9 JfL kirr 

s M (x) ~ ^ E G fe sin_ ZT’ 

k=1 

where {Gf } is the DST of {g(jL/N)}. If we replace x by the sample points jL/N , 
we get 



k=l 
M 


N 


EN 

fe =0 


sin ■ 


N 

7rjk 




where the sequence {T/f } is defined by 


Gf for fc = 1,... , M, 

0 for k = M + 1,... , IV — 1. 


( 6 . 6 . 11 ) 
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Similarly, we approximate Fourier cosine series and obtain 



2 

N 




M 


0 


E g : 


£ cos 


k=1 


kirjk 

N 


M 


N 




cos - 


7T jk 




k=0 


( 6 . 6 . 12 ) 


where 





10 


for k = 0, 

for k = 1,... , M, 

for k = M + 1,... , IV — 1. 


6 .6.2. Radix 2 FFT. Let IV = 2 r , where r is a positive integer. We denote 
the 7V-point DFT by 

A—1 

p k = J2 u w n> ( 6 - 6 - 13 ) 

3=0 

where Wn is defined above. 

First Stage. The FFT algorithm begins by halving this 7V-point DFT into two 
sums, each of which is a A/^/2-point DFT: 


A/2-1 A/2-1 

F k = E ^ ( w%) ik + Y, A+i {w 2 N ) jk w%, 

3=0 3=0 

which can also be written as 

F k = F° k +W k N Fl 

A/2-1 

U°= E hi ( W N ) jk > 

3=0 

A/2-1 

Ft= E AWf- k = o,i,-..,N-i. 

3=0 


(6.6.14) 


(6.6.15) 


Note that the binary (base 2) expansion of the indices of /o, / 2 , • • • , /a -2 all end 
with 0 because the indices are even; thus, we have superscript 0 in Again, 

the binary expansions of the indices /i , f%, ... , /a-i all end in 1; thus, we have the 
superscript 1 in { F £}. Using the prefix ‘DFT’ for ‘DFT of’, we can represent these 
superscripts as 


{F fe °} = DFT {A} = DFT {/...!}. (6.6.16) 
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Since N = 2 r , we divide N evenly by 2, which gives W^ 2 = 1, which lets us 
rewrite the first equation in (6.6.15) as 

F k = F* + W%Fl F k+N/2 = F*-W*Fl for k = 0,1,... , N/2 - 1. 

(6.6.17) 

We can represent the computations in (6.6.17) by the following butterfly diagram: 


F k 


F M 


N 


F k 


Fk -► F k~ W N F k, k =0, l,...,A/2-l 

There are N /2 butterflies at this stage of the FFT and each butterfly needs one mul¬ 
tiplication which is W]y x F k . In Fig. 6.6.1 we have listed all the butterflies needed 
at this stage when N = 2 4 . We can split {F k } into two half-size DFT’s, { F k } and 
{F k }, on {F*?} and {F k } themselves, which yields 

Fk = F k° + (W$r) k F°\ F ° +n/4 = F° k ° - ( W 2 N ) k F° k \ 

F l k = + (W%) k Fl\ F l k+N/4 = Fl° - (W 2 n ) k Fl\ (6.6.18) 

for k = 0,1,... , N/4 — 1. 


(U) 


(V) 


u 

f 3° 

F 4 

F 5 

F 6 

F 1 


F o 

F 2 

F 3 

F 4 

F s' 

F 1 
6 
FI 
~ 7 








HHSHHB 















HB9 



Ha 




fo 


o + 'o 
w 


F\ + 
f 2 0 + 


w 


lP 2 


F°, W 3 fJ 
3 + 3 


f 4 + 


W‘ 


F 5 ° + W 5 

F U 


f°+w 7 


4 17 1 
4 

F S l 

w 6 f 6 ' 


F 1 


F 2— F 1 
0 0 


f l°- 


W JJ 1 


f£- W 2 Fl 
F 3°- W3f 3 


F 4°- 


w 4 f 4 ' 

t - 1 


F 5 °- W j F 5 j 
F 6 °- W 6 F 6 ! 
F °- W 7 F l 


Fig. 6.6.1. First Reduction of FFT for N = 2 4 . 


Note that in (6.6.18) {F 1 ^ 0 } is the f-point DFT of {/ 0 , / 4 , /s, • • •, /a- 4 }, {F 1 *? 1 } the 
f-pointDFTof {/ 2 , / a f N - 2 }, {U°} the f -pointDFTof {A, / 5 ,..., / w _ 3 }, 
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and {F 1 ^ 1 } the ^-point DFT of {/ 3 , /jv-i}- This is represented in terms of 

the binary expressions of fj by 


{if 5 } = DFT {/...oo}; {if} = DFT{/... 10 }; 
{U°}=DFT{/...oi}; {if} = DFT {/...„}. 


There is a reversal of the last two digits (bits) in the above binary expansions of the 
indices j in {fj} for which we compute the ^-point DFTs {F 1 ^ 0 }, {F 1 ^ 1 }, {F 1 ^ 0 }, 
and {F 1 ^ 1 }. The two stages of the FFT are presented in Fig. 6.6.2. 



"A A 

H^+WH^ 

h 2 o+w 2 h} 

Hf+ W 3 Hj 

Hj+ W A Hl 
Hj>+ W'f 

«{>+w 6 « 6 ' 

h 7 °+w 1 h^ 


H ] 0_w// 1 1 
H®- W 3 H^ 

H$>- W 4 // 4 ' 
f- W 5 /f 


Fig. 6.6.2. Two Stages of FFT for N = 2 4 . 

If this process is continued by halving the order of the DFTs, then after log 2 N 
stages we arrive at a point where we are performing N one-point DFTs, which for 
a number fj is the identity fj —> fj . Since the process of indexing the smaller 
size DFTs by subscripts where the reversing order of the bits in the indices of {fj} 
continues, it so happens that by the time the one-point stage is reached all bits in 
the binary expansion of j are arranged in the reverse order, as shown in Fig. 6.6.3, 
Hence, the FFT computation is started by first rearranging {fj} so that it is listed in 
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bit reverse order. 


f 000...0 = DFT ^ 000 ,.. o ] ► 

/010...0 = DFT [/lOO...o] 
/100...0 = DFT[/oio...o] —► 


/oil...l = DFT t/011...1] 
/111...1 = DFT[/ m 1 ] 


DFT [/...ooo] 
DFT[/ ...100] 

DFT [/ ... 010 ] 
DFT[/ ...no] 
DFT[/ ...ooi] 
DFT[/...ioi] 

DFT[/...oil] 

DFT[/...ih] 



Fig. 6.6.3. Reduction of FFT and Bit Reversal. 


The main components of the FFT are: (i) bit reversal reordering of the initial data; 
(ii) rotations involved in the butterfly computations; and (iii) computation of the sines 
need for (ii). The savings in the computer time with FFT are enormous. For each of the 
log 2 TV stages there are TV/2 multiplications; thus the total number of multiplications 
needed for the FFT are \ log 2 TV, as compared to the direct computation of DFT 
which takes (TV — l) 2 multiplications. For example, for TV = 2 10 , the FFT requires 
5120 multiplications whereas the direct DFT will require 1 046 529 multiplications, 
which means that in FFT the saving in multiplication time is by a factor of about 204. 

Bunemann’s algorithm performs the bit reversal permutation as follows: If the TV 
numbers {0,1,... , TV — 1} are permuted by bit reversing their binary expansions, 
then the permutation of 2N numbers {0,1,... , 2N — 1} is obtained by doubling the 
numbers in the permutation of {0,1,... , TV — 1} to get the first TV numbers and then 
adding 1 to these doubled numbers to get the last TV numbers. 


Table 6.6.1. 


r 

r/ log 2 r 

r 

r/ log 2 r 

r 

r/ log 2 r 

2 

2.00 

5 

2.15 

8 

2.67 

3 

1.88 

6 

2.31 

9 

2.87 

4 

2.00 

7 

2.49 

10 

3.01 


Minimization of Number of Operations. The number of operations 
(additions and multiplications) for TV-point Fourier analysis is TV 2 . By factoring TV = 
r x 5, the number of operations = r 2 s + s 2 r = TV x (r + 5 ). In general, by factoring 
TV = n x 7*2 x ... x r m , the number of operations = N x (n + + • • • + r m ). For a 

minimum, v\ = ... = r m = r, N = r m , i.e., m = log r TV, the number of operations 
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Table 6.6.1 represents the value of log 2 r for 


= TV • r • log r TV = TV • logo TV • - 

log 2 r 

r = 2,... ,10. For additional information on DFT and bit reversal permutation, see 
BitReversalAlgorithms.pdf on the CD-R; for Bracewell-Bunemann code see 
f f t. f 90 and BracewellBunemann. nb on the CD-R; 


6.6.3. FFT Procedures. Assuming that a Fourier series subroutine exists 
such that its input is the complex sequence fj, j = 0,1,... ,7V — 1, and output the 
Fourier series (or IDFT) F k defined by (6.6.2), Cooley et al. (1970) have described 
the following seven FFT procedures that are based on the FFT algorithm (§6.6.4). 

Procedure 1. Fourier Transform. Let Fj/N replace f) as input and 
fj replace F k as output. Then the subroutine (6.6.3) will compute the DFT fj. 

Procedure 2 . Fourier transform of two sets of real data in 
ONE PASS THROUGH A dft subroutine. If Fj and Fj are real sequences such 
that Fj 4—> fj , Fj < —> fj, and F k = Fj + i Fj, then, by the linearity property, 
F k has the transform fj = fj + i fj. Replacing j by TV — j and taking complex 
conjugates of both sides, we get f^-j = fj — i fj- Solving these two relations for 
fj and fj we obtain 


fj = \ [f-j + M - fi= \ [f-j ~ M ‘ (6.6.i9) 

Thus, Procedure 2 is: (a) form F k as defined by F k = F^ + iF%; (b) compute 
fj by means of the DFT subroutine; and (c) compute fj and fj by (6.6.19) for 
j = 0,1,... ,TV/2. 

Procedure 3. Doubling algorithm for computing Fourier trans¬ 
form OF 27V POINTS FROM THE TRANSFORMS OF TWO 7V-POINT SEQUENCES. 
Given 27V data points Y k with Y k <—» yj for j, k = 0,1,... , 27V — 1, suppose the 
two 7V-point sequences Fj = Y^ k and Fj = Yzk+i, k = 0,1,... ,7V — 1, have the 
7V-point transforms fj and fj such that Fj <—» fj and Fj < —» fj, respectively. 
Separating the even- and odd-indexed points in the series for y 3 , we have 


27V—1 , N—l N—l x 

Vi = 2N 57 Ffe w ™ = 2N 57 Lfe w^ ik + L fe+ 1 W~^ k ~ j 

k=0 ^ k=0 k=0 ^ 

, N—l N—l x 

= 2 n\ 57 Y2k W Y + 57 W N jk W 2 _ 7 since W 2N = W N , 

^ k=0 k=0 ^ 

in which the summations define fj and fj, respectively, so we can write yj as 


Vi = 2 


1 // • /f»A 


( 6 . 6 . 20 ) 


Substituting N + j for j and using the fact that W^ N = —1, we get 


VN+j = 2 


1 f 1 _ f2 W ~j 

Jj Jj VV 2N 


( 6 . 6 . 21 ) 
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Thus, Procedure 3 is: (a) compute the two 7V-point DFT’s of the sequences Fj = F 2k 
and Fl = F 2k+ U and 

(b) apply (6.6.20) and (6.6.21) to the resulting transform. 

This procedure, when iterated upon to produce successive doublings up to TV, 
which is the total number of points, is the FFT algorithm with radix 2, as described 
in §6.6.2. 

Procedure 4. Computation of the dft of real data. Using Proce¬ 
dures 2 and 3, the transform of a single sequence of 27V real data points is computed 
by one DFT of TV complex points. The details are as follows. First, assume that 
Y k , k = 0,1,... , TV — 1, is the real sequence, and let Y k <—» y 3 . Then, form the 
7V-point sequences 

Fl=Y 2k , F% = Y 2k +i, F k = Fl+iFl (6.6.22) 

Compute the 7V-point Fourier transform of F k and use Eq (6.6.19) to obtain the 
transform of the two real sequences Fj, Fj in terms of the DFT of F k ; then use 
Procedure 3 and Eq (6.6.20) to obtain the transform of the entire array Y k . Since Y k 
is real, it means that the upper half of the y 3 array is redundant; thus, y 3 = y 2N _y 
Since Fj and Fj are real, fj and fj are conjugate even. Then, replacing N by N + j 
in (6.6.20) we obtain 

y N+j = \[f] ~f]W^]. (6.6.23) 

We can effectively use (6.6.20) and (6.6.23) for j = 0,1,... ,7V/2. It can be easily 

27V—1 

seen that the coefficients y 3 in Y k = y 3 k = 0,1,... , 2 N — 1, are the 

3=0 

sine-cosine coefficients of the series 

Yk = \a 0 + Y, jaj cos^ + bj sin ^| + \ (-l) fe a N , 

where aj = 2 $t{yj} for 0 < j < N, and bj = —2^{?/j} for 0 < j < N. Thus, 
Procedure 4 is: (a) let the 27V-point array Y k be put in a complex TV-point array F k 
as defined in (6.6.22); 

(b) compute the 7V-point DFT of F k \ 

(c) use Eq (6.6.19) for j = 0,1,... , N/2 to get fj and fj; and 

(d) apply Eqs (6.6.20) and (6.6.23) for j = 0,1,... , N/2 to get yj for j = 0,1,... , N. 

Procedure 5. Computation of Fourier series for real data. This 
is performed by reversing Procedure 4. The details are as follows. Solve (6.6.20) and 
(6.6.23) for fj and fj in terms of y 3 and yN+j> be., 

fj = Vj+VN+j, (6.6.24) 

fj = [Vj ~ VN+j} W 3 2N . (6.6.25) 
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Then solve (6.6.19) to obtain 


fj fj • iff- (6.6.26) 

fpf-j = fj ~ i fj- (6-6.27) 

Thus, Procedure 5 is: (a) use (6.6.24) and (6.6.25) to generate fj and fj for j = 
0,1,... ,JV/2; 

(b) use (6.6.26) and (6.6.27) to generate fj for j = 0,1,... , 7V/2; and 

(c) compute the IDFT of the 7V-element complex array fj. The result will be the 
sequence F k whose real and imaginary parts are the real elements of Y k as defined 
by (6.6.22). 

We can also use Procedures 4 and 5 to transform a conjugate even data sequence 
F k to a real frequency sequence fj, and conversely, by letting F k /N* replace fj and 
fj replace F k , thus switching the roles of ‘frequency’ and ‘data’. 

Procedure 6. Computation of cosine series for real data. Since 
Yk are real and even, its IDFT will be a cosine series. Thus, if >&, £; = 0,, 1,... , 27V— 
1, is real and Y k = Y 2 N_ k , then 


^Z 1 N—l 

Y k= Y y i W 2 N = \ «0 + E cos — + \ (-l) fe a N , 
k= 0 7=1 

where a 3 are real and a 3 = 2y 3 .Thus, the DFT of Y k can be written as a cosine series 

O N - 1 /jr q 

yj = „[h Y o+ E Y k cos-E -|-1 (-i )* Yn _ . 

To derive the procedure for computing a cosine transform of real data Y k , k = 
0,1,... , 2 N — 1, such that Y^N-k = Y k , we only require Yo, ... , Yjy. First, define 
the complex sequence 


F k = Y 2k Yi [IWi - Y 2k -i] for k = 0,1,... , TV - 1, (6.6.28) 

where we actually need to form only terms with k = 0,1,... , TV/2, since being a 
complex even sequence, its transform fj must be real. Procedure 5 is an efficient 
method to transform a conjugate even sequence to a real sequence. Thus, let the 
conjugate even sequence Fj/N be the input to Procedure 5, and the output will be 
/j, which is the real DFT of F k . Once fj is obtained, use Procedure 2 to obtain the 
transforms of real and imaginary parts of F k . Thus, define Y 2k <—> fj , Y 2k+1 <—> 

fj, and Yj k = Y 2k +i — Y 2k _\ < —» fj . Use Eq (6.6.19), remembering that fj is 
real, to get 

fj = 5 [fj + f-j] - fj' = Ti Ifj ~ f-i 1. (6.6.29) 
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and derive Y^k-i 


W N J fj , which gives 


ft =fl-w 1 


-3 f 2 


i.e., 


p2 

3 


i-wj 


Next, we need to compute 


TV-1 

fo = E y 2 fe+l. 


fe =0 


(6.6.30) 


(6.6.31) 


Finally, Procedure 3 takes us from fj and fj to y 3 , which is the DFT of Y^. Thus, 
substituting (6.6.29) and (6.6.30) into Eq (6.6.20), we get 


a j — 2 Uj 



fj-f-j ] 
2 sin ( 717 /IV ). 


}■ 


j = 1 , 2 ,... ,N- 1, (6.6.32) 


where for j = 0 and j = N we use 


2/0 = 5 [fo + fo] - 2 /JV = \ [fo ~ fo] ■ (6.6.33) 


Thus, Procedure 6 is: (a) given the real even sequence Yk for k = 0,1,... , 2N — 1, 
define F & by (6.6.28); 

(b) let Fj/N be the input to Procedure 5; the output will be fj = fj ; 

(c) compute y 3 using (6.6.32) for j = 1,, 2,... , N— 1; let fj = fo and compute f§ by 
(6.6.31); then use (6.6.33) to get yo and y^; finally, let a 3 = 2 y 3 for j = 0,1,... ,1V. 

Procedure 7. Computation of sine series for real data. If Y k , 
k = 0,1,... , 2N — 1, is real and odd, it can be expressed as a sine series 


27V—1 27V—1 ., 

Y k = E yi n = E b 3 

3=0 J=1 

where b 3 are real and b 3 =2 i y 3 . Since Yq = Yn = 0, we find that 


b 3 = v Y Yk 

k =1 


Since is real and odd, iYk is conjugate even, so its transform is real. Thus, 
Yk < —» y 3 = bj / (2 i), and iYk <—» iyj = \ bj. Hence, if we let 

Fk = - \X2k+ 1 - Y 2 k-i] + i Y 2k , (6.6.34) 


and use the same method as in deriving (6.6.32), we obtain 


bj =2 i Vj 


I { [fi ~ f-j\ 


fj ~ f-j ' 

2 sin( 7 r//lV). 


}• 


j = 1,2,... ,N- 1. (6.6.35) 
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Thus, Procedure 7 is: (a) given the values Y k , k = 0,1,... ,1V — 1, of a real odd 
sequence Y k , k = 0,1,... , 2N — 1, form F k by (6.6.34); 

(b) let F p /N be the input to Procedure 5; the output will be /* = fj ; 

(c) compute bj using (6.6.35) for j = 1,, 2,... , N — 1. 

Note that Procedures 6 and 7 provide a four-fold decrease in computation and 
storage requirements since only one-half of the real input data arrays need be supplied. 
The complex data F k to be transformed contains only N/2 terms rather than 2N 
required if full array Y k is supplied for a complex DFT subroutine. 

The effect of sampling of a function f(t) at finite interval leads to the evaluation 
of f(t) at the points t k = k At , k = 0, ±1, ±2,..., with T = 1/At, by 

/ oo OO »{k+l)T 

F(uj)e 2 ™ k “ /T duj= Y / F(uj)e 2i * kuj / T duo. 

-°° fc=-oo l feT 

Since the exponential factor e 2 ™ kM l T i s periodic in w with period P, the above relation 
can be written as 

r p 

f(kAt)= F {p \w)e 2 ™ kujlP du, 

Jo 

oo 

where F^ (u) = F + jP) is the periodized function F(u), defined by 

j = - OO 


F< p )(w) = - ^ f(kAt)e~ 2i7TkM/p . (6.6.36) 

k= — oo 

The effect of sampling in the frequency domain at the points uo n ,n = 0,=bl,=b2,..., 
A oo = 1/T, we can rewrite (6.6.36) as 

1 oo 

F (p \nALo) = - Y f(kAt)e~ 2i7Tnk/N , 

k= — oo 

oo 

where IV = TP, and f(kAt) = XI / ((fc + jN)At). This represents the sample 

j = - oo 
oo 

values of (t) = XI /(£ + jT), which is a periodic function of t with period 

j = -oo 

T. Thus, substituting T /N in place of 1/P in (6.6.36), we get 

1 7V_1 

F( p \nAu) = — ^ Tf p (kAt) e ~ 2i7vkn ^ N . 

k =0 

This relation can be represented in the form (6.6.4) if we let hj = Tf p (kAt) and 
H k = p( p ) (jiAu). This proves the following result. 
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Theorem 6.6.1. (Cooley etal. 1970) If /(t) <—► F(u), then 

Tf p (kAt) <—> F {p) (nAw) for k, n = 0,1,... , N - 1. (6.6.37) 


6.6.4. FFT Algorithm. The actual computation of the finite Fourier trans¬ 
forms has many applications. Although the number of data points must be finite, it 
can be very large on the order of 10 3 or 10 4 , which requires a considerable amount of 
computer time. An algorithm for this purpose that involves a drastic reduction in the 
computation, by a factor of N/ log 2 A, was developed by Cooley and Tukey (1965). 

6.6.5. Linear Multistep Method. By using the Bjorck-Pereyra algorithm 
and FFT techniques we obtain some quadrature rules to approximate the finite range 
integrals of the form Jq {nh — x)~ 1 ^ 2 f(x) dx, where h denotes the step size, and 
T = nh , n = 1,2,... , N; N = 2 R , R E Z + . These rules are derived from 
approximations to Iq (/), which are generated by the implicit linear multistep method 
(LMM). These formulas provide good accuracy for functions / of the form f {pc) = 

/o + /i x 1 / 2 + f 2 x + fsx 3 / 2 + f 4 X 2 -\ - asx —> 0, with suitable ‘starting’ weights. 

A Fortran code is available in Baker and Derakhshan (1987). 

We use the k- step method, which is used in initial value problems in ordinary 
differential equations, and consider the approximation 

pnh n 

/ f(x)dx « h y^Wnj f(jh ), n > k, (6.6.38) 

Jo J=0 

where w nj , j = 0, 1,... , fc — 1, are determined by the starting approximation for 
f™ h f(x) dx, n = 0,1,... , k — 1, and are defined by 

w n j = oj n — j, j = k,k T 1,... , n, 


where ooq, uoi ,..., are the coefficients in the expansion of 


Lj(fl) 


Am 3 


(X 0 + LO 1 jl + C 1 J 2 


2 


and 


p{/l) — 0^0 p k + OL\ fl k 1 + • • • + 

cr(/i) = 0o p k + Pi p k 1 + • • • + (j 7^ 0, 

denote the first and second characteristic polynomials in the LMM. This leads to the 
formula 


1 


/ 7T 


rnh 

L ( 


I {nh — x) 1//2 f(x) dx 


^E< / 2 7 ou, 


(6.6.39) 


i =o 
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where W^ 2 ^ = , and 

Q( 1//2 )(/i) = {cj(p)} 1 ^ 2 = Qq 1//2 ^ + ji + Q,^ 2 ^ P 2 + • • • • (6.6.40) 

For a suitable choice of the ‘starting’ weights W^ 2 \ j = 0,1,... , 2p — 2, is 
made to ensure that approximations (6.6.39) are of order p for the class of functions 
f(x) = fo + fi x 1 / 2 + /2 t + /3 t 3 / 2 + /4 t 2 H-b F(x), where F(x) is smooth. 

The role of FFT involves the computation of the coefficients of a product of two 
polynomials. Thus, if u(pc) = X^=o ] u i x% an d v{pc) = v i x% denote two 

2n—2 

polynomials, then their product p(x) = ix(t) v{pc) = XI Pi has the coefficients 

i=0 

m 

Pm = ^ ^ H j XfYi—j , TYl = 0,1,... , 2fl 2. (6.6.41) 

j=0 

The FFT technique is used to compute these coefficients p m as follows: 

Let {ixo, Hi,..., Hn— u 0,..., 0} and {vo, ir, ..., v n -\, 0,..., 0} be two sequences, 
each with 2 n elements, where n = 2 m \ m e Z+, and let {CTo, E4, • • •, /7 2n -i} 
and {Vo, hi,..., V^n-i} denote the two sequences that are obtained after computing 
the DFTs of the above two sequences; i.e, 

2n—1 

U k = -= V Uj e - i7r ^/ n , (6.6.42) 

V2n ^ 

and similar expression for Vk . Then, 

^ 2n—1 

Pk = — V Vj D ie -™ jk / n , k = 0,1,... ,2n-2. (6.6.43) 

j=0 

The transformations from {u 3 } to {Uk}, {vj} to {14}, and {VkUk} to {p 3 } are 
carried out by fast routines such as C06FAF, C06GBF and C06FBF, available in the 
NAG library, which compute a transform, conjugate of a Hermitian sequence, and an 
inverse transform, respectively. 

Thus, using (6.6.39), we compute a finite number of the coefficients Q,^ 2 \ 

j = 0,1, 2,..., in the formal power series (6.6.40) by the above FFT technique. Let 

n-i ( . 

[Q (1/2) (m)] n = /i J denote the truncated formal power series (6.6.40). 

3=0 

Thenthesequence{Qo 1//2 \^i 1//2 \ • • •, ^n^-i } i s computed. Itdefines [Q^^ 2 \p)] N 
for N = 2 r , R G Z + . Once this sequence is computed, we solve the system of linear 
equations in order to determine the starting weights W^ 2 ^ for j = 0,1,... , 2p — 2, 
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which is done by using the formula 

nh n 

(nh - x)~ 1/2 f(x) dx-Vh^2 W^/ 2) f{jh) 

3=0 

= O(hp) as h —» 0 , 

(6.6.44) 

with nh = T fixed, for any f(x) = /o + fi t 1//2 + /21 + /3 x 3 ! 2 + x 2 + • • • + 
f 2 P -3 x v ~ 3 ! 2 + / 2 p -2 + F(x), where F(x) e C p [0, T], and then solving the 

system of equations 

2p—2 nk 

A y] W§ /2) (jh) m/2 = -j= J (nh- x)- 1 / 2 x m / 2 dx 

n 

— Vh ^ for m = 0 , 1 ,... , 2p — 2 . 

j=2 P -i (6.6.45) 



6 . 6 . 6 . Computation of Fourier Coefficients. As Lyness (1987) has 
noted, the term ‘FFT’ describes both a series of methods and a series of computer 
codes to rapidly evaluate transform approximations. We will discuss how an FFT 
may be used to obtain approximations to Fourier coefficients. 

For Fourier cosine and sine coefficients of a real function, we provide an even 
integer m as radix 2 , with m items of data {ao, ai,... , a m / 2 > 60 ? • • • 7 b m / 2 - 1 }, 

defined by 

2 rn—l 

a s = — dp cos27r ks/m, 
m k =0 

2 m—1 

b s = — V ] dp sin27rA:5/m, 
m k=0 

Then what an FFT program does is simply as follows: The code involves a ma¬ 
trix multiplication of an m x m matrix whose elements are either cos27r ks/m or 
sin 2irks / m. If coded as it is, this involves m 2 multiplications and m 2 additions. But 
it can be coded so that it involves only log 2 m multiplications. When m is very large 
(say, 2 10 ), it saves time in data manipulation by a larger factor (of 100). When m is 
small (say, 2 4 ), the relative time saving factor is much smaller (of 4). But only data 
manipulation time is reduced; the time spent on computation of function values d k 
or processing the output a s , b s remains the same. 

Let 

do = \ if (a) + f(b )\, 

dk = f(a+— — —)=f(x k ), k = 1,2,... ,m-l. 

V m ) 


s = 0,1,... , m/2; 

5 = 0,1,... , m/2 — 1. 


(6.6.46) 
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Then the FFT routine yields the quantities 


+ tb s = - Y"f(a + e 2^ks/r, 

rn V m / 


k =o 

2 g—(27 visa)/ ( b—a) 

b — a 


b — a 


rn 




3 2 Trisxk / (b—a) 


k =0 


(6.6.47) 


The quantity within the square brackets is the m-panel trapezoidal rule for the 
approximation of the integral representation of the Fourier coefficients, which is 
J a 6 f(x ) e 2 ^isx/(b-a) for 5 = 0,1,... , m/2. This provides a very useful FFT 
routine if we have the m + 1 equally spaced function values and seek to compute a 
set of m real (or m/2 complex) Fourier coefficients using the trapezoidal rule. 

6.6.7. Filon-Luke Rule. Once the Fourier coefficients are computed by FFT, 
we take (3 = 2ms / (mh) and M panels, each having d + 1 nodes. This requires d + 1 
(possibly d) sums of the form 


M —1 

^ ^ y (ci -|- kh Tj) 
fe =0 


27ris(a+/c /i)/ (Mh) 


(6.6.48) 


where 5 is an integer. For the j-th sum of this form, we set dk = / (a + fcfo + Xj), 
k = 0,1,... , M — 1, in the FFT routine, which returns a s and 6 S (given by (6.6.47) 
with m replaced by M). Then the sum (6.6.48) becomes equal to 

Y ( a s + ib s ) e 2 ™a/{Mh)' 

Some minor modifications are needed if Xj = 0 or h. The FFT routine defined in 
Giunta and Murli (1987) and Lyness (1974, 1984) are useful for this purpose. 


6.7. Hartley Transform 

The FFT requires a large computer time, but the fast Hartley transform (FHT) can get 
the same results only faster, as shown by Bracewell (1986). The Fourier transform 
maps a real function of time f(t) onto a complex function of frequency F(uj), and 
it requires many arithmetical operations of complex multiplication or division, and 
two for complex addition or multiplication. But the Hartley transform maps a real 
function of time f(t) onto a real function of frequency H(uo ), where the Hartley 
frequency is real, and thus it needs only single arithmetical operations to compute it. 
Since the real data needs only half of the memory storage required for the complex 
data, the Hartley transform takes considerably less memory for a given set of data 
than the Fourier transform. 
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The Hartley transform and its inverse are defined by 

H(u) = — / f(t) cas(27 xuot)dt, (6.7.1a) 

27r J -oo 

/ oo 

H{(jS) cas(27ro;£) duo, (6.7.1b) 

-oo 

where cas(0) = cos(0) + sin(0), a notation which was introduced by Hartley (1942). 
The complementary function of cas (t) is cost — sin t = cas(— t) = cas'(£), where 

cas'(t) = — cas (t). The properties of the cas function are: 

cas (u + v) = cos u cas v + sin u cas' v, 
cas (u — v) = cos u cas' v + sin u cas v, 
cas u ca,sv = cos(u — v) + sin (u + v), 
cas u + cas v = 2 cas \ {u-\-v) cos \{u — v), 
cas u — cas v = 2 cas' \ {u-\- v) sin | (u — v ). 


Let the even and odd parts of H(u) be denoted by E(u) and 0(u), respectively. 
Then E(—u) = E(u) and 0(— u) = —0(u), and we have 

E(u) = —— = f f(t) cos(27 root) dt, 

2 J —oo 

0(o;) = ———— = f f(t) sm(27Tu;t) dt, 

2 J —oo 

and 

/ oo 

/(t) e" 2 *™* 

-oo 

Comparing with the Fourier transform F(u), we find that !ffi{F(t<;)} = E(u), 
%{F(cj)} = -O(cj), and conversely, H(cj) = E(cj)} - ${E(u;)}. 

Let the asterisk * denote the convolution and the pentagram * the cross-correlation 
of two functions fi(t) and / 2 (£). Then 

/ oo 

fi(t~u)f 2 (u)du, 

-OO 

/ OO 

h(t + u)f 2 (u)du. 

-oo 


If one or both of the functions entering into convolution is either even or odd, then 
the Hartley theorem on convolution is the same as the Fourier theorem; i.e., if fi(t) 
is even, then fi (t) * f 2 (t) has the Hartley transform Hi (cc)i7 2 (cc). But if one of the 
functions is odd, there is a corresponding simplification, that is, if fi (t) is odd, then 
fi (t) * fi(t) has the Hartley transform Hi (o;)iJ 2 (—a;). The theorems for the Fourier 
and Hartley transform are compared in Table 6.7.1. 
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Table 6.7.1. Theorems for Fourier and Hartley Transforms. 


Theorem 

m 

F(u) 

H(u) 

Similarity 

f(t/T) 

\T\F{Tcj) 

|T| H{Tu) 

Addition 

fl{t) + /2(£) 

Fi(u>) + F 2 (u>) 

Hxiw) + H 2 (oj) 

Reversal 

/H) 

F(-u) 

ff(-w) 

Shifting 

f it - c) 

e-^ic" F {w) 

sin(27rcct;) H{—u) + cos(27tcc<;) H(u) 

Modulation 

f(t) cos(27ra;o£) 

\ [F(w - wo) + F(u + w 0 )] 

i [H(ui - wo) + H{u) + wo)] 

Convolution 

fi(t)*f 2 (t) 

F 1 (J)F 2 {u) 

1 [ffi(w)ff 2 (w) - 
+H 1 (lj)H 2 {-l>) + H\[ — w)i/ 2 (w)] 

Autocorrelation 

m*m 

|FH| 2 

±{[H(u)}* + m-u) 2 }} 

Product 


* ^ 2 ( 0 ;) 

\ [tfi(w) * H 2 {u) + J?i(-w) * H 2 (oj) 
+ffi(w) * H 2 (-lj) - * H 2 (-u))\ 

Derivative 

m 

27rza; F(lj) 

—2iuj H{—u) 

2nd Derivative 

nt) 

—47 t 2 lj 2 F(u) 

—47 t 2 lu 2 H(u) 
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The Fourier and Hartley transform pairs, as defined by (6.1.3a-6.1.3b) and (6.7. la- 
6.7, lb), respectively, deal only with continuous variables. But since the computer 
data is sampled at discrete intervals of time or for a specific time interval, we need 
discrete definitions. Thus, the discrete Hartley transform (DHT) pairs are defined by 

N -1 

H{d) = N~ l /(*) cas(27 rut/N), 

t =0 

N—l 

f(t) = H(u) cas(27 rut/N), 

LO =0 

where the factor TV -1 ensures that 77(0) is equal to the mean value of f(t), which 
keeps it in harmony with the convention that the Fourier coefficient cio be equal to the 
d.c. value of a periodic waveform. This can be compared with the discrete Fourier 
transform (DFT) defined by (6.6.2). In fact, the factor TV -1 is borrowed from DFT 
practice where 7\0) is the d.c. value of f(t); otherwise the DHT transform becomes 
asymmetric. Thus, the problem of computation of the DHT is analogous to that of 
DFT, which involves TV 2 arithmetic operations to compute the DHT of TV-element 
data. As we know, the DFT uses a permutation process to bisect the data until data 
pairs are reached. Then computing the Fourier transform of such data pairs becomes 
very rapid. The basic idea behind this permutation process in the DFT is that it is 
faster to split the data into pairs, compute the transform of the pairs, and recombine 
them to recover the entire transform rather than to compute the transform of the entire 
data set. Bracewell (1983) showed that precisely the same technique can be used with 
the DHT. The theorems for the operation of discrete Fourier and Hartley transforms 
are compared in Table 6.7.2. 

The Hartley transform of a data pair, say, a and b, is \ (a + 6, a — b), and com¬ 
putation of such pairs is very simple. Also, these two-element sequences (pairs) can 
be superimposed to compute the Hartley transform of the input data set. However, 
for this purpose we need a formula that expresses a complete DHT in terms of its 
half-length subsequences. The general decomposition formula for bisecting the data 
is (Bracewell 1983) 

H(cj) = Hi( cj) + H2(oo) cos(2tt(jo/N s ) 

+ 77 2 (TV s — cj) sm(27TLu/N s ), (6.7.3) 

where N s is the number of elements in the half-length sequence; thus, N s = TV/2 for 
a data set of TV elements. Formula (6.7.3) can be compared with the corresponding 
formula for the DFT which is F(cj) = Fi(uo) + i^o;) e 2 ^ tuJ / Ns (see the butterfly 
diagram in §6.6). The butterfly diagram of the DHT for an 8-element data set is 
presented in Fig. 6.7.1, where the indices in the first column of the cells show the 
effects of the permutation on the data elements; the next three columns represent 
the data elements as superimposed by the decomposition formula for the butterfly 
computation. These cells show the three indexes of the elements. The effects of 


(6.7.2a) 

(6.7.2b) 
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Table 6.7.2. Theorems for Operations of Discrete Fourier and Hartley Transforms. 


Theorem 

Function /(r) 

DFT F{v) 

DHT H(is) 

Reversal 

f(~ T ) 

F{-v) 

H(-ts) 

Addition 

fi(r) + / 2 (r) 

Fi(v) + F 2 {v) 

Hi(v) + H 2 (v) 

Shifting 

fi T ~ a) 

e -27riav/N 

cos(2 Tzav/N) H{v) — sin(27rai/ /N) H(N — v) 

Convolution 

fi(t) * hit) 

NF^F^u) 

\ N[Hi{v)H 2 {v) - Hi{-v)H 2 {-v) 
+H 1 {is)H 2 {-is) + Hi{-v)H 2 { is)] 

Autocorrelation 

m*m 

\ N\F(v)\ 2 

N{[H(is)} 2 + [H(-ts) 2 }} 

Product 

hit) hit) 

Fi^) * F 2 {is) 

i N[Hi(u) * H 2 (v) - Hii-ts ) * H 2 {—v) 
+H\{v) * H 2 {-v) + Hii-v) * H 2 ( is)} 

Derivative 

m 

27 riv F{v) 

2nisH{-is) 

2nd Derivative 

nt) 

-4n 2 is 2 F{is) 

-4t t 2 is 2 H(is) 
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retrograde indexing for the 8-element data set is seen in indexes for the third and 
fourth iteration of the butterfly. The bottom row of the butterfly diagram gives the 
angular spacing (in radians) between the trigonometric coefficients. 

The difference between the FFT and FHT is as follows: In FFT the elements 
multiplied by the trigonometric coefficients involve terms only in F(u), but in the 
FHT both H(cj) and H ( N s — uo) have sine coefficients; thus, the elements multiplied 
by the trigonometric terms are not symmetric in the FHT. Although asymmetric, the 
discrete transforms can be expressed as matrix operations. While the FFT matrix 
terms are symmetric about the leading diagonal, the corresponding terms in the FHT 
are asymmetric. This asymmetry introduces some computational problems because 
it is difficult to process asymmetrical matrices. It leads to retrograde indexing which 
occurs when we use an independent variable as an index for the elements multiplied 
by the sine coefficients, thereby decreasing this index while increasing other indexes. 



7C 7C/2 7C/4 


Fig. 6.7.1. Butterfly Diagram for the HFT. 

The inverse Hartley transform can be obtained by applying the FHT algorithm 
again to its own output, which regenerates the input data. This means that we can use 
the same computer program to compute the transform and its inverse. But there is a 
slight asymmetry between the FHT and its inverse obtained by this method. In the 
case of the time-to-frequency transform, to obtain the discrete Hartley transform, we 
must scale the result of the butterfly computation by dividing the output of the butterfly 
by N, where N denotes the number of elements in the input data set. However, this is 
not needed for frequency-to-time transform; thus, the butterfly computation is itself 
the inverse transform. All we need is to attach a code to control whether the scaling 
is applied during a conversion. 
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6.7.1. Comparison of the FFT and FHT Algorithms. This compar¬ 
ison deals with the following issues. 

1. The FHT algorithm can be used in many applications where FFT is applicable. 

2. The Fourier transform itself can be obtained from the Hartley transform, and 
it is faster to generate the Fourier transform and power spectrum with the FHT than 
with the FFT, because computation of the butterfly using real quantities rather than 
the complex ones needs fewer floating-point operations. 

3. The real and imaginary parts of the (complex) FFT can then be obtained from 
the FHT at the end of the computation by using the formulas 

= H(lo) + H(N - Lo ), $S{F(u)} = H(u) - H(N - u), (6.7.4) 

where N denotes the number of elements in the data set. 


4. The power spectrum P s can be computed directly from the Hartley transform 
by using the formula 

P s (uj) = \ [H(uj ) 2 + H(N - u) 2 ] . (6.7.5) 

5. The formula for the convolution of a pair of functions is almost identical in 
Hartley or Fourier transform (see formula (6.1.6) for the Fourier transform). The 
convolution of a pair of functions for the Hartley transform is defined by 

fi ( t ) * f 2 (t) = H x (u) H 2e (u) + Hii-u) H 2o (u), (6.7.6) 

where the subscript V and ‘o’ denote the even and odd parts of the Hartley transform, 
such that if one of the functions being convoluted is either even or odd, the form of 
the convolution (6.7.6) reduces to the simpler formula 

fi(t)*f2(t) = H 1 (u>)H 2 (u>), (6.7.7) 


which is similar to (6.1.6). Since in practical applications many convolution functions 
are even, e.g., the Gaussian function used in image processing, we can use formula 
(6.7.7) with computational advantage. 

6. As in the case of FFT, the FHT algorithm will produce an erroneous frequency 
function if the data set to be transformed does not approach zero smoothly at both 
endpoints of the range. This phenomenon is known as the spectral leakage , which 
can be reduced by multiplying the data set to be transformed by a suitable window 
function W(n) prior to computing the transform. Such window functions are dis¬ 
cussed in Stigall et al. (1982) in their effect on the power spectrum. Some window 
functions are described below. Additional information is available in Harris (1978) 
and Nutall (1980). 


(i) Triangular window is defined by 


W(n) 


2{n + 0.5) 
n 


W(N-n-l) = W(n ), 


n = 0,1,... ,N/ 2; 


(6.7.8a) 
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it is of a low quality, but very fast, and is used to filter noise from telemetry signals 
in real time. 

(ii) Hanning window is defined by 

W(n) =0.5 (l- cos n = 0,1,. .. , N — l. (6.7.8b) 

(iii) Hamming window is defined by 

W(n) = 0.54 — 0.46 ^1 — cos ^ ? n = 0,1,... , iV —1. (6.7.8c) 

(iv) Blackman window is for data sets where the Hanning/Hamming windows 
are not suitable. It is defined by 


W(ri) = 0.42 — 0.4 cos 


2tt (n + 0.5) 
N — l 


n = 0,1,... , N — l. 


(6.7.8d) 


6.7.2. FHT2D Program. The computer code ht. f 90 uses the ‘cas’ function 
to compute the discrete Hartley transform y of a given data set x. A driver program, 
ht2d. f 90, initializes the test data set, computes the Hartley coefficients, the inverse 
of the coefficients (which should be the original data), and prints the results. A 
second code for computing Hartley transforms is hart ley 2d. f 90 with its driver 
program xf ht. f 90. The hart ley 2d. f 90 program does not use the ‘cas’ function 
approach and produces slightly different results than those obtained by ht. f 90. The 
corresponding MATLAB codes are f ht. m and f ht 2d. m, and the Mathematica code 
is f ht2d. nb. All these codes are available on the CD-R. 
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Inversion of Laplace Transforms 


The inversion of the Laplace transform on the real line is well known to be an ill- 
posed problem, since it basically deals with solving a Fredholm integral equation 
of the first kind (see Chapter 9). In view of this ill-posedness, there are different 
Laplace inversion methods, some of which, as expected, give better results for certain 
classes of transforms and not for all transforms. In this chapter we present various 
approximation formulas for the indicial function f(t) and indicate where a particular 
method converges and where it fails numerically. 


7.1. Use of Orthogonal Polynomials 

The Laplace transform pair is defined as 


POO 

= f{t)e~ st dt, 3?{s} > c, (7-1.1) 

Jo 

1 nc-\-ioo 

C-'iKs) } = f{t) = — / f(s) e st ds, (7.1.2) 

ZZ7T J Q—iQQ 


if the function f(s) exists, such that all singularities of f(s) are situated to the left 
of $?{s} > c. The integral (7.1.2) is known as the Bromwich integral (also as Mellin 
integral), and the function f(t) is sometimes called the indicial function. The Laplace 
transform / (5) exists for 5 > c, if the function f(t) is piecewise continuous for t > 0 
in every finite closed interval 0 < t < T (T > 0), and if f(t) is of exponential 
order a, i.e., there exist a, M > 0, and to > 0 such that e~ at \f(t)\ < M for 
t > to. The inversion of Laplace transforms can be regarded as a special case of 

323 
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integral equations of the first kind on the interval (0, oo), where the free term is 
f(s) whose inverse Laplace transform is an unknown function f(t) for 0 < t < oo. 
It is also obvious from the effect of a small-amplitude perturbation, which yields 
C~ 1 {f( s ) + (s — 1 — i 6) -1 } = f(t) + e^ 1+z6 ^, that as b —> -boo, the perturbation 
(s — 1 — i b)- 1 tends uniformly to zero on the real line, but the corresponding term on 
the right becomes unbounded. Also, the inversion problem is ill-posed (see Chapter 
9), which makes it very interesting. We will present different numerical methods for 
computing the function f(t). 

Some of the earliest theoretical results on the inversion problem are those by Post 
(1930), Widder (1935), Bateman (1936), and Boas and Widder (1940). These results 
deal with the integral (7.1.2). Thus, Post and Widder prove that 

fk —1 poo ofc 

m = l s? e ~'“] /w P' 1 ' 3 ) 

whereas Boas and Widder show that if the integral (7.1.2) converges for 5 > co, then 
for each c > cq 


pOO 

f(t)= lim e ct t k ~ x / Qk(t,u) f(u + c) du, (7.1.4) 

k^ oo Jo 


Qk 

where Q k {t,u) = c k [u 


2k—1 ml 


, with ci = 1, and c& 


for 


kl(k-2)1 

k > 2. Formula (7.1.4) holds for / £ L\{ 0, oo). Recently, Byun and Saitoh (1993), 
assuming that / £ 1 / 2 ( 0 , oo), obtain the representation 

pOO 

f(t)= f(s)e~ st p N (st)ds , AT = 0,1,2,, 

Jo 

where Pn(x) are the polynomials defined by 

(-1 Y+ 1 (2 n)\ 


0 <v<n<N 


Pn{x ) = 

4 


(n + 1)! v\ (n — v)\ (n + v)\ 


r n+V 


2 in T 1 o 

x z - 


( -r + 3 Ti + 1^2; + n(ri + ^ + 1)1. 

\n + v +1 ) ), 


n + v + 1 


(7.1.5) 


It is proved that the sequence {/tv(0}tv=o conver S es t0 /(0 i n the sense that 
lim | f(t) — /n(J)\ 2 dt = 0. The representation (7.1.5) is generalized by Byun 

-/V—s- oo 

and Saitoh to functions / £ I/ 2?g , q > 0, which is the class of all square integrable 
functions with respect to the measure t x ~ 2q dt on the half-axis (0, oo), and they prove 
that 

p oo 

/(*) = 8- lim / f(s)e~ st p Nt q(st)ds , (7.1.6) 

JV^oo lo 
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where 


PN,q{x) = ^ 


(—1)" +1 T(2n + 2q) 


{ 


o <v<n<N 

2 (n + q) 


isl (n — is)\ T (n + 2q + l) T(n + is + 2q) 


n+v+2q-l 


x <; —--— x“ — 

- Ti -\- is 2 q 


2 (n + q) 
ti -\- is 2 q 


+ 3n + 2 qj x + n(n + ^ + 2g) |, 


and the limit is taken in the L^^q space of the polynomials PN, q (x). Note that for 
q = 1/2 the polynomials Pn,i /2 is different from that in Boas and Widder. 

Krylov and Skoblya (1977) describe the following three methods which use or¬ 
thogonal polynomials. Let p n (x), n = 0,1, 2,, denote a system of orthogonal 
polynomials on [0,1] with respect to the weight w ( x) . The related generalized Fourier 
series for <j)(x) is 


oo «i 

<t>(x) ~ Y ak Pk( X )i a k = w(x)<p(x)p k (x)dx. 
k =0 

If we take a finite sum of the n terms of the series as 

n 

S n{x) = Y a kPk(x), 


(7.1.7) 


k =0 


then the polynomial S n (x) E V n can be regarded as an approximation to the function 
(j>{pc). Thus, the function (j>{pc) can be expressed in terms of orthogonal polynomials 

n 

p n (x) by <j)(x) = c kPk(x). Now, we will consider some special cases of the 

k =0 

weight function w(x). 

Shifted Jacobi Polynomials. (§ 1.2.11) Denote Pn ^\x) = X] x 1 . 

i =0 

The weight function is w(x) = x a (l — x)@, and = Ck/y/rk, k = 0,1,... , n, 
where 


c k = Y a i k) 7(0- 

i =0 

r(fc + q + 1 ) r (k + (3 + 1 ) 

rk = k\ r(2 k + a + (3 + 1 ) T(k + a + (3 + 1 ) ’ 
and the image function is given by 


m = YakP* k {a ’ l3 \x) = s r^ 


k =0 


k =0 


rk 


(e-*). 


(7.1.8) 

(7.1.9) 

(7.1.10) 
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Shifted Legendre Polynomials. (§1.2.9) w(x) = 1, r n = 1/(2 n + 1), 

and 

oo 

/(t) = ^(2fc + l)c fe P fe *(e- t )- (7.1.11) 

k= 0 

Shifted Chebyshev Polynomials. (§1.2.10) For Chebyshev polynomials 
T*(x), we have w(x) = t _1//2 (1 — t) -1 / 2 , r n = 7r/2 for n/0, and ro = 7r, and 

oo 

co+ 2 5 > fe T fe *( e “3 
fc=l 

or, in terms of the trigonometric representation of T* (x), 

/ 6\ i r 00 ^ 

— 2 In cos-J = — c 0 + 2^c, cosifefl . (7.1.12b) 

I- k =1 -I 

For Chebyshev polynomials U*(x), we have w(x) = x 1//2 (l — x) 1 / 2 , r n = 7 r/ 8 , and 

8 °° 

/(*) = - (7.1.13a) 

fe=0 

or, in terms of the trigonometric representation of C7* (x), we have 
/ 0 \ 8 °° 

/( — 2 In cos - ) = - ; —- sin (fc + 1)0. (7.1.13b) 

V 2 / 7 r sin 0 ' 

fe=0 

If we use the similarity and shifting properties of the Laplace transform, we find 
from (7.1.1) that 

e ~iot/h e~ st dt for any h > 0 . 

If we write this expression as 


(7.1.12a) 



hf(lo J rhs)= / e st k(t) cj)(t) dt, 

Jo 

where k(t) cj)(t ) = e~ lot / h f(t/h ), or cj)(t) = [ k (t )] _1 f(t/h) e~ lot / h , set h = 70 , 

and expand f(t/h ) = k(t) e f (j)(t) in terms of the shifted Legendre polynomials and 
shifted Chebyshev polynomials of the first and second kinds, we obtain the following 
expressions for f(t/h): 

For the shifted Legendre polynomials P*(x), where k(t) = e _t , we find from 
(7.1.11) that 


f(t/h) = k(t) eV(i) = <i>{t) = E( 2/c + Cfe P k ( e *) • (7.1.14) 

k =0 
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ForChebyshevpolynomialsT*(x), wherefc(t) = e t ^ 2 (1 — e f ) 12 , we find from 
(7.1.12a) and (7.1.12b) that 

f(t/h) = k(t) e l 4>(t) = e t/2 (l - e _t ) _1/2 <j>(t), 

f (-i tacos l) = ^*(- 2 ,acm i) 

2 r 00 

= - Co + Y Cfe cos k6 

tv smO 

L k= 1 

For Chebyshev polynomials U* (x), where k(t) = e 3t//2 (1 — e t ) 1 ^ 2 , we find from 
(7.1.12a) and (7.1.12b) that 

f(t/h) = k(t) eV(^) = e -t/2 (l - e _t ) 1/2 <f>(t) 

, 2 ^\1 / 

h ^ C ° S 2/ = 2 sin6,< K “ 21n C0S 2) 

4 °° 

= —^ °k sin (^+1)0- 

7r sm 6 1 ' 

fe =0 

These results, though theoretically robust, do not quite sit well in computation; 
the factor 1/ sin 6 creates errors in the neighborhood of 6 = 0. Thus, these formulas 
can be used if we want to evaluate f(t) in the neighborhood of some nonzero value 
to , and not the entire real axis. In this case the parameter h can be chosen so that the 
substitution x = e~ ht takes the point t = to into x = i.e., 6 = 7t/ 2. This will 

reduce the effect of the factor 1/ sin 6 to the minimum. Since the coefficients of the 
Jacobi, Legendre, and Chebyshev polynomials used in these formulas as well as the 
coefficients c n defined by (7.1.8) increase very rapidly with increasing n, the above 
formulas are not very effective unless the starting values of the ‘weighted moments’ 
are specified with great accuracy. The next section will discuss some application of 
these orthogonal polynomials in computing f(t) from a given / (s). 

In a survey article Davies and Martin (1979) have discussed different methods 
for numerically inverting the Laplace transforms. They include methods that expand 
f(t) in exponential functions, methods based on Gaussian quadratures using the 
Laguerre and Chebyshev polynomials, methods based on a bilinear transformation, 
methods based on Fourier series, and methods based on accelerated convergence of 
a Fourier series. They have compared methods by Bateman (1936), Bellman, Kalaba 
and Lockett (1966), Cooley, Lewis and Welch (1970), Cost (1964), Crump (1976), 
Dubner and Abate (1968), Durbin (1974), Lanczos (1956), Papoulis (1956), Piessens 
(1969, 1971, 1973, 1975), Piessens and Branders (1971), Salzer (1955), Schapery 
(1962), Stehfest (1970), ter Haar (1951), Weeks (1966), and Widder (1934). In the 


(7.1.16a) 


(7.1.16b) 


(7.1.15a) 


(7.1.15b) 
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sequel we will discuss these methods and others. Davies and Martin (1979) have also 
presented two measures for the accuracy of the numerical solution; they are 



£(/(0.5j)-/(0.5i)) /30, 

3 = 1 

Le = ^ 

30 2 30 

(H (/(°- 5 7) -/(°- 5 J)) ) e-H 2 j (D e_j/2 ) 

\ J=1 J=1 


(7.1.17) 


(7.1.18) 


where L gives the root-mean-square deviation of analytical solution f(t) and the 
approximate solution f(t) for values oft = 0.5(0.5)15, and L e is a similar measure 
weighted by the factor e~ l . 


7.2. Interpolatory Methods 


We use the following property of Laplace transforms: If > 0 and all singularities 

of f(s) are located to the right of the line = c > 0, and if f(t) is of the 

exponential order a , then lim^isi^^ f(s) —» 0, and f(s) = e~ a 4>(s), where </>(s) 
is regular and bounded in the half-plane > c. The function (j)(s) can then 

be interpolated by a linear combination of a complete system of functions. The 
interpolating functions are chosen with argument s _1 and the interpolating points 
along the real axis. Let Pfc(s _1 ) be n + 1 interpolating polynomials of degree n in 
s _1 , and 5 = so, M, • • • s n denote the nodes situated to the right of c. Then 


/00 = s~ 


s)> 4>(s) = Pk [ S -i\ ^( s k) + r n (s), 


where 


Pk(s ) = 


IK*" 1 -*,- 1 ) 

z=0 


Using (7.2.1) and (7.2.2) in the integral (7.1.2), we obtain 

-I rC+ioo f 


c —zoo L 


s~ a e st 


n / _i\ 

^ 7-n 0(gfc) +r n (s) 

i t^Pk( s k ) 


(7.2.1) 


(7.2.2) 


ds= A k (t)<f>(s k ) + R n , 


where 




1 , 8t 


Rn = 




c—zoo 
c+zoo 


Pk (fife 1 ) 


zV 4> ( s k) e st ds, 


s a e at r n (s) ds. 
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If we set 


Pk (s 9 

Pk (Sfe 1 ) 


k 

</>(sk) = 

i =0 


, where ftki are known constants, then 


k 


i =0 


fiki 

r(« + i) 


j.a+z-1 


To simplify computation we choose the points Si equally spaced with S{ — s^_i = 1; 
then by translation along the real axis, we can take so = 1. We will derive inversion 
formulas by using the Legendre, Chebyshev, Jacobi, and Laguerre polynomials; for 
properties of these polynomials, see § 1.3. 

7.2.1. Use of Legendre Polynomials. 

7.2.1(a) Papoulis’ Method. (Papoulis 1956) Let the logarithmic time scale 

x be defined by e~ at = x for a > 0. Then the time interval [0, oo) is mapped 

( In x \ — 

-J = (j)(x), and the inverse (7.1.1) becomes crf(s) = 

fo x^/^^^x) dx, which yields 

cr/((2fc + 1) cr) = f x 2k (j)(x) dx. 

Jo 

We will extend the definition of cj)(x) to the interval (—1,1) by defining 4>(—x) = 
4>(x). Then (j)(x) becomes an even function and is expanded in terms of a series of 
Legendre polynomials of even order, i.e., <j)(x) = J2fcLo c k ^ 2 k(%)- Hence, 


f{t) = Y J CkP2k{e~' 7t ), (7-2.3) 

k =0 


where c& are determined by taking the Laplace transform of P^k(e at ), which leads 
to 

f ( \ - ^ I V" ( s ~ a )( s - 3cr)... [s - (2k - l)a] 

s s(s + 2a) ... (s + 2kcr) ° k ’ 

in which, by replacing s by cr, 3cr, 5cr,... , (fc + l)cr,..., we obtain a system of (k +1) 
equations 


cr/(cr)) = C 0 , 
af ((2k-\-l)a) 


cr/(3cr) = |co + ^Ci, 

Co 2 k ci 

= 2fc + l + (2fc + l)(2fc + 3) + '" 
2 k k\ Ck 


{2k + l)(2fc + 3)... (4/c + 1)' 
which can be solved to determine the coefficients c/, : . 


(7.2.4) 
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— 2 at 


„—4at 


The choice of the scaling factor a depends on the number of terms considered 
in the series (7.2.3). A simplification of formula (7.2.3) for the case of a six-term 
expansion is presented in the following form which minimizes the round-off errors: 

f(t) = (b 0 - — + - B 2 - — B 3 + — B a - — Bj) 

J w V 2 8 16 128 256 3 J 

+ ? (Bl _§ B2 + f B3 + g B4 + g§ B5 ) 

23i/ 13 195 n 6(rt 

+ i6\ B3 ~Y B4+ — B5 ) e 

+ ™*( B 4 -^B 5 )e-^ + ^B 5 e 
128 V 2 V 256 

where Bj are given in terms of the values of sf(s) in Table A.28; the quantities 
Dj in this table correspond to the data points such that Dj = 5 /( 5 )| s _( 2 j+i)cr f° r 
j = 0,1,... ,5; the values given in Table A.28 are the coefficients of Dj, where 

5 

Bj are defined by Bj = ctjk Dj. 

k =0 

7.2.1(b) Lanczos’ Method. (Lanczos 1956) This method differs from the 
above method in that it uses the shifted Legendre polynomials which are orthogonal on 
the interval (0,1). Take£ = e~ l in (7.1.1). Then we get/(t) = /(—ln^)^ s_1 d £, 

and 


_ —10 at 


(7.2.5) 


'd£, = Vk, 


f(k + 1)= / 1 /(-lnC)C fe rfC= [\m k 

Jo Jo 

where <j)(s) = /( — In s). For an arbitrary polynomial 

n 

Pn(0 = a hC = a n + + <*n£ 2 ^- 


i =0 


we have 


i =0 i =0 


- C-T) 


where c n are known because a l n and y i = 1) are known. We will express 4>(x) 

in terms of the shifted Legendre polynomials P*(x) (see §1.3.2), which are defined 
on the interval [0,1] by : 

n 

<t>{ x ) = J2 AnP n( x ^ 

n=0 

A n = (2 n + 1) f <p(x)P*(x) dx = (2 n + 1 )c n . 

Jo 
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Then we use the property <j){x) = f(—lnx) = + l)c n P*(x), an d fi n d 

that the function /(£), which is the inverse of /(s), is defined in terms of Pn(x) 
by (7.1.11). Since the terms 2k + 1 and are large, even a slight variation in c n 
produces a large variation in the value of f(t). In computing formula (7.1.10) we 
often need to evaluate c n to well over 10 decimal digits, which becomes difficult 
when we are taking about 10 terms in this formula. 

7.2.2. Delta Function Methods. 

7.2.2(a) Cost’s Method. A summary of some approximations to f(t) is 
given in Cost (1964). These approximations are based on the sifting property of 
the Dirac delta function, namely, J 0 °° f(t) 6 (t — to) dt = / (to), to > 0. If we 
differentiate (7.1.1) n times under the integral sign with respect to 5, we obtain 

ri n - r°° 

— f(s) = (-1 r J o f(t) [e e ~ st ] dt, (7.2.6) 

where the function within the square brackets is called the intensity function. Since 

OO 1 

J 0 °° t n e~ st dt = n+1 , we multiply the intensity function by s n+1 jn\ and obtain 


— t n e~ st ^ 6 (t-to), 


(7.2.7) 


where to is any specific time at which the delta function is not zero. Assuming that 
the delta function is located at the point t = n/s, which is the maximum of the left 
side of (7.2.7), we find from (7.2.7) that 


6 (t — n/s) 


(7.2.8) 


Using Stirling’s formula we have lim ? 
stituting (7.2.8) into (7.2.6) we get 


oo — r~ t n e st = 6 (t — n/s). Then sub- 
n\ 


q n+l fin _ poo 

= J o - n / s ) dt = /W 


q n +1 fin 

fit) = lim [(-l) n — r -j-^fis) , 

77—»oo L n\ ds n J S=n/t 


(7.2.9) 


which is Widder’s inversion formula. 


7.2.2(b) Alfrey’s Approximation. Alfrey (1944) uses the approximation 
formula 

P-2.10) 
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which is the first-order pn = 1) approximation of formula (7.2.9). Hence, this formula 
has the same limitations as Widder’s. 

7.2.2(c) ter Haar’s Formula, ter Haar (1951) uses the approximation 

m*[sf(s)] s=1/t , (7.2.11) 

which is derived by multiplying and then dividing the integrand in (7.1.1) by t, thus 
yielding 

Since J 0 °° te~ st st = 1/s 2 , the function in the square brackets resembles a delta 
function and we may, therefore, use the approximation t e~ st « 6 pt — to) / s 2 . Thus, 

s 2 /(s)~/ Up-6 (t - to) dt, (7.2.12) 

where to can be taken as the point at which s 2 t e~ st has its maximum value. The 
approximation (7.2.10) follows from (7.2.12) by the sifting property of the delta 
function. Thus, ter Haar’s approximation is of the same type as Widder’s formula 
(7.2.9) for n = 1, although the indicial functions in (7.2.9) and (7.2.12) differ by a 
factor of 1 ft, which results in somewhat different approximations in these two cases. 

7.2.2(d) Schapery’s Approximation. Schapery (1962) uses a different 
location of the delta function, which is taken at the centroid of the intensity function 
in the log t scale at the point st « 0.5. Thus, this approximation is given by 

f(t)=[sf{s)\ s=05/t . (7.2.13) 

This method is limited to problems where sf(s) is only a linear function of log 5. 

7.2.2(e) Least Squares Method. First proposed by Schapery (1961) and 
then described by Cost (1964), this method deals with the time-dependent initial and 
boundary value problems which have solutions of the form fpt) = C\ + t + Opt), 
where C\ and C 2 are constants and Opt) is the transient component of the solution 
defined by 6(t) = J 0 °° H(r) e _t//r dr, where H(r) is a special function, which 

m 

is taken as a series of delta functions such as H{r) = hi (r — rp. Then the 

m m 

function Opt) = hi e~ l l T% can be approximated as Opt) ~ 6*pt) = Y/ 9i 
2=1 2=1 

where gi and a t are constants to be determined by minimizing the mean square 

error E 2 between Opt) and 0*pt) defined by E 2 = J 0 °° [Opt) — 6*(t)) 2 dt = 0, for 
i = 0,1,... , m. This minimizing process yields 

—— = / 2 [Opt) — 6 * (£)] dt = 0, i = 1, 2,... , m, 

V9i Jo 
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or 



i = 1, 2,... , m. 


This mean square error will have a minimum only if the Laplace transform of the 
approximation is equal to that of the exact function at least at the m points 5 = 1/c^, 
2 = 1,... , m. This provides m relations between the Laplace transform of 6(t) and 
that of each evaluated at s = l/c^, i.e., 


S(s) 


S = 1/ OL % 


e*(s) 


a=l/a 


i = 1,2,... , m, 


which reduces to the system of equations 


S(s) 


S = 1/ OL % 


m 


E 


9j 

1 j OL-i T \ / QLj 


2 = 1 , 2 ,... , m. 


These equations can be solved to determine gi in terms of the values of 6(s) at the 
points 5 = 1 /ati. Finally the constants C\ and are determined from the initial and 
boundary conditions. 

7.2.3. Use of Chebyshev Polynomials. 

7.2.3(a) Lanczos’ Method. (Lanczos 1956) First normalize f(t) such that 
/(0) = 0, as done in §7.1.4(a) in the case of the Laguerre polynomials. We denote 
the normalized function by /(t), set £ = e~ l in the inverse (7.1.1), and obtain 

f(s) = f /(— lnf)f s_1 d£ = [ /(f)f s_1 df, 

Jo Jo 

in which substituting £ = (1 + cos 6)/ 2, we get 

/(-Inf) = /(f) = /((1 + cos0)/2) = 

Since ^(0) =0 and 6 = tt corresponds tot —> oo, we have = 0. Thus, 
can be expanded in terms of sin k 6 as 

4 00 1 f 7r 

'0(6 ) ) = — bk sin k6, bk = - / ^(fl) sinfc0d0. (7.2.14) 

If we transform # back to £, then the coefficients bk in (7.2.14) can be expressed as 

1 f 1 sin k9 f 1 

bk= o -tp{0) sin k0d0 = / /(f) . „ rff = / /(f)E4_i(f) df, 

^ Jo Jo smt/ Jo 
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where Uk-i (£) is the Chebyshev polynomial of the second kind and order k — 1. If 

k 

U k (0 = ^ a*£\ then 

i =0 


bk= r mUk-i(H)d!i= f 

7o i=0 

fe 1 n\ k 1 

= ^2 a i 4>{QCd£ = '^2a i f(i + l). 

• n Jo a—c\ 


Thus, bk can be determined since a 2 and /(i + 1) are known. 

7.2.3(b) Papoulis’ Method. (Papoulis 1956) also uses Chebyshev polyno¬ 
mials. If we set x = e~ at = cos 6*, cr > 0, then the interval (0, oo) transforms into 

/ In cos 0 \ 

(0,7r/2), and /(£) becomes / (-j, which gives 


° 7 ( s ) = 


r /2 , 

/ (cos 0) ( 

Jo 


s/a)-l 


sin[0/(0)] d6 , 


and with 5 = (2 k + 1) 6*, k = 0,1,2,..., we obtain 


<r/((2fc + 1)0) 



sin[0/(0)] d6. 


Without loss of generality, we assume that /(0) = 0; if not, then subtract a constant 
from /(0), if necessary. The function /(0) is expanded in the interval (0, tt/2) into 
an odd-sine series 

oo 

f(0) = ^C k sin(2 k + 1)0, (7.2.15) 

k =0 

where the coefficients Ck are determined by solving the system 


- c/fc) = Co, 

7r 

2 2 - af(3a) = C 0 + C\, 

7T 


2 2 ”-c/((2n+l)cr) 

7T 



/ 2 ri 


l\ n . 


2 n 

2n — 1 


Co 


2 n 

k — 1 


C n -h 


c n 


(7.2.16) 
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or recursively by 


\C n =a2 





Cj- (7.2.17) 


The values of the coefficients C n on the right side of (7.2.16), computed for n = 
0,1,... ,10, are given in Table A.29. 


Once the coefficients Ck are determined, the function f(6) can be computed from 
(7.2.15) by using the approximation 


N 

/n( 0) = E Ck sin(2 k + 1)0, 

k =o 


since /n( 6) —> f(6) as TV —> oo. This approximation is well known from the theory 
sm ( n _|_ 7)6' 

of Fourier series. Since- : — - = U n (x), cos 6 = x (see §1.3), where U n (x) 

sm 6 

are the Chebyshev polynomials of the second kind, and sin 6 = (l — e~ 2la ) , we 
find from (7.2.15) that 


oo 

m = (1 - e _2i<T ) 1/2 Y, Ck U 2 k (e- CTt ) • (7.2.18) 

k =0 

4 1 

Example 7.2.1. (Papoulis 1956) (a) f(s) =-~- , with cr = 0.2, 

w 7T (s + 0.2) 2 + 1 

which has the exact solution f(t) = — e~°' 2t sin t. 

- 7T 1 7r 

(b) f(s) = — —j===, a = 0.2, which has the exact solution f(t) = — Jo(t). 

Since /(0) ^ 0, the function f(6) is discontinuous at 6 = 0, and / n(6) exhibits 
the Gibbs phenomenon. The coefficients Ck for both examples are given in Table 
7.2.1(a). The values of / n(6) computed for 6 = 0 (7t/36) tt/2 are presented in Table 
7.2.1(b). 

Other authors have used different orthogonal polynomials; e.g., Shohat (1940) 
uses the Laguerre polynomials; Salzer (1955) uses the generalized Bessel polynomi¬ 
als discovered by Krall and Frink (1949); Piessens (1969b) improves upon Salzer’s 
work and gives a new quadrature formula for the inversion of the Laplace trans¬ 
form; Piessens (1971) also develops another quadrature formula using the generalized 
Bessel polynomials. These investigations are for a class of functions / (s) that can 
be approximated by polynomials in 1/s. Luke (1968) in his review of the book by 
Bellman et al. (1966) suggests the use of the shifted Jacobi polynomials to compute 
inverse Laplace transforms. But only Piessens (1972) develops the details of such an 
approach, achieving better accuracy than previous methods. 
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Table 7.2.1(a). Values of C n . 



Example 7.2.1(a) 

Example 7.2.1(b) 

k 

C k x 10 4 

C k x 10 4 

0 

1724 

1961 

1 

3154 

4899 

2 

205 

4009 

3 

-2075 

460 

4 

380 

633 

5 

530 

1762 

6 

-754 

166 

7 

474 

862 

8 

-193 

718 

9 

-40 

199 

10 

58 

982 


Table 7.2.1(b). Values of f N (0). 


Example 7.2.1(a) Example 7.2.1(b) 


0 

/a(#) x 10 4 

In(0) x 10 4 

7t/36 

398 

8133 

7t/18 

432 

8739 

tt/12 

1158 

6958 

7t/9 

2511 

7787 

57t/36 

3362 

7896 

7r/6 

4215 

6363 

7?r/36 

5571 

5977 

2tt/9 

6029 

5241 

7t/4 

5181 

2612 

57t/18 

4048 

615 

ll7r/36 

1944 

-834 

7t/3 

-1502 

-3208 

13tt/36 

-3272 

-3190 

77t/18 

-1590 

286 

57t/12 

570 

1748 

47t/9 

694 

-11 

177t/36 

-33 

-312 
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7.2.4. Use of Jacobi Polynomials. 

7.2.4(a) Piessens’ Method. (Piessens 1972) Assume that / (s) can be rep¬ 
resented as 

oo 

f(s) = s~ a c k Pk a,l3) (! - bs- 1 ), (7.2.19) 

k =0 

where denotes the Jacobi polynomials of degree k , and a, a, (3 and b are 

free parameters; their choice will be discussed later. The coefficients are given by 

Cfc = J- J (1 -u) a {\ + u ) 13 (u) ^(u) du, 

where 

hk = J (1 - u) a (l + u ) 13 [pj, a,l 3 \u )] 2 du, 

«»)=( r ^;) /(A)' 


Inverting the series (7.2.19) term-by-term, we find that 


m 


t a ~i 

r>) 




k =0 


(a + l)fc 

k\ 



where (a +1) & is the Pochhammer’s symbol, (a +1) o = 1, and (pk (x) is a polynomial 
of degree k defined by 


<t>k(x) 


2^2 


—/c, k ol T f3 1 

O 1, CL 


To evaluate numerical values of c&, we note that if the series (7.2.19) is truncated 
after M + 1 terms, we obtain 


/w 


1 (2k + a + f3 + 1) T(k + a + /3+l) /&£ \ sr' t 7 p(«,/ 3 ) / % 

r>) T. 2 “+/5+ 1 r(a + i)r(fc + /3 + i) <pk \lJ2-' j k [Uj) ’ 

k —0 j — 1 


(7.2.20) 

where N is the order of the Gauss-Jacobi quadrature formula (see §4.3.1), u 3 are the 
nodes and V 3 = w 3 pj ( u 3 ) the weights, w 3 being the weights of the Gauss-Jacobi 
quadrature. In the special case when a = (3 = — 1/2, formula (7.2.20) becomes 


f(t) 



(7.2.21) 
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where 

(t>k{x)= 2 F 2 k -x , 

. 2 ’ a 

and the coefficients are obtained by using Clenshaw’s method for the computation 
of Chebyshev coefficients as 


Ck ~ 



(7.2.22) 


or 


Ck 


2 

TV + 1 


A 


m=0 


(2m + l)7r\ 
2(TV + 1) ) 


cos 


/ (2m + l)fc7r\ 

V 2(JV + 1) b 


k < N. (7.2.23) 


In formula (7.2.22) we need the value of lim sf(s). If this limit is not known, we 

s —>oo 

use formula (7.2.23). 

The polynomials (j)k(x) in formula (7.2.21) become very large as k increases, and 
they have alternating signs. For example, some of these polynomials are 


4>o(x) 

M x ) 

M x ) 

fa(x) 

4>i( x ) 


l, 

2 

1-X, 

a 


1 --X+-,——rzX , 
a a(a + 1) 

48 


x 2 — 


32 


■ x 


18 

1 — — T H - ^ ^ 

ft ft(ft T 1) ft(ft T l)(ft T 2) 

_ 32 160 2 _ 256 * 

ft ft(ft + 1) ft(ft + l)(ft + 2) 


+ 


128 


ft(ft + l)(ft + 2)(ft + 3) 


x 


x\ 


In general, by using Fasenmyer’s technique (see Rainville 1960), 4>k(x ) for formula 
(7.2.20) can be determined from the recurrence formula 


(j) k (x) = (A + Bx)</> k -i(x) + (C + D x) <j> k - 2 (x) +E</> k - 3 {x ), k > 3, 


where 


(2n T cy T /7)(2n T or T /3 — l)(ft T ti — l)(ft T xl — 2)(n — 1) 
(or 77/) (ft H - 77/ — 1) (277/ 4“ 0 T 4“ f3 — 3) (77/ 4~ or 4“ /3) 

77/(277/ 4- a 4- /? — 1) 

77/ 4~ or 4~ /3 
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£ (2tt« + oi + (3)(2n + q + j3 — 1) 

(cy H - 77/) (ft H - 71 — l)(77/ -p H - /3) 

C = -l- A- E, 


TL ~\~ Ql (3 — 1 

E = g (» ~ 2)(n + f3 - 2)(a + 1 - n - a - 0) 
(2 n + a + (3 — 3) (2n + a + (3 — 4) 


0oO) = 1, 


0i 0) = 1 


020 ) = 1 


cy + (3 + 2 
a(a + 1) 

2(ci + (3 + 3) (cy + (3 + 3)(ti + (3 + 4) 2 
o(a+l) 3:+ a(a + l)(a+l)(a + 2) ^ 


The parameter a must be such that f(s)^s a ass— >00. However, there may 
be functions /(s) for which such an a does not exist. 

Generally it is convenient to take a = 0 = —0.5. This choice simplifies the 
calculations considerably. However, these values of a and 0 are not suitable when 
the Laplace transform is known in a small interval on the real line. In that case formula 
(7.2.22) must be used and the value of N must be so low that it satisfies the condition 

7T b - 

cos —-- <1--, where [0, A] is the interval in which f (s) is known. This 

2(N +1) ~ A 1 1 w 

restricts the number of coefficients that can be calculated. The problem can be 

avoided by taking a large and (3^1. 


The value of b is related to the interval of convergence on the real line for the 
series in (7.2.19). The minimum value of $?{s} for which the series in (7.2.19) is 
convergent is 5/2. 

Piessens computes the polynomials 0& (x) and gives a generating formula for these 
polynomials. Hypergeometric functions are available in Mathematica; for details see 
piessens .nb on the CD-R. Finally, the error is given by 


m 


t a 1 / bt\ 


(7.2.24) 


Formulas (7.2.20) and (7.2.21) are compared with those by Salzer (1958) and Luke 
(1969), where Salzer approximates the Laplace transform f(s) by an interpolating 
function f(s) ~ s~ a Qn(1/s), where Q n {x) is a polynomial of degree TV; this 
formula uses equally spaced interpolation points Sk = k. The approximating function 
is then inverted exactly. If N is large, this inversion loses accuracy. Luke’s method 
is a generalization of methods of Erdelyi (1943), Lanczos (1956), Miller and Guy 
(1966), and is also related to the method of Bellman, Kalaba and Lockett (1966) (see 
§4.3.1). In this method the original function f(t) is obtained as a series of shifted 
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Jacobi polynomials 


N 

m » (1 - 2“ A T e~ bt Y p t 0) ( 2e ~ xt - 0 - 

k =o 

where a, /?, A and b are free parameters, and 


A (2k + a + /? + 1) r(2A: — m + q + f3 + 1) 

T(£; + o + l) \my T(£; — m +/? + 1) 

x F (A (fc — m + (3 + 1) — 6). 


Example 7.2.2 Piessens (1971) considers two examples: (i) /(s) = 


a/s 1 + 1 


— p (i/ s ) cos(2\/7) 

for which /(£) = J 0 (t), and (ii) /(s) = -, for which /(£) = - -= -, and 

V s v 71 "^ 

compares the results for these two examples with those of Salzer, Luke, and the exact 
solution. 


7.2.5. Use of Laguerre Polynomials. 

7.2.5(a) Lanczos’ Method. (Lanczos 1956) First, normalize both f(t) and 
f(s) by setting 5 = z + a, and multiplying both sides of the integral (7.1.2) by e~ at . 
This leads to 

-i r + i00 _ 

0(4 = f(t)e~ at = — / <j>(z)e zt dz, (7.2.25) 

2Z7T J — 200 

where cj)(z) = / 0 °° (j>(t) e~ zt dt. We assume that 0(0) = 0; if it is not, we replace 
(j)(t) by (j)*(t) = cj)(t) — ae~ f , where a = 0*(O) = lim z f(z). Note that 0(z) 

z^-oo 

is analytic in the right half-plane including the imaginary axis. The entire right 
half-plane > 0 is mapped onto the unit circle by the transformation 


1 — v 2 2 dv 

=-= —1 H-, dz = — --— 

1 + v 1 + v (1 + v ) 2 


{z+l? 

2 


dv , 


which takes the imaginary axis into the unit circle. Then Eq (7.2.25) becomes 


b*(t) = f 1 , 

2m 


- f 1 — V 


K 1 + V 

Using Maclaurin’s expansion, we have 

'I-tA 2 


3 (i-v)U( 1 +^). 


(i+v) ; 


dv. 


I + v) (1 + v) 2 


= £ 


CfeU fe , 


fe =0 
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OO \ bt 

* )= £ 2 ct (fey^ 

Let z = 1 + z \. Then 


OO 

4>0 +Zx)= ^(Zi) = E 2 Ck 
k =0 


(~i ) fc 4 

(2 + 2i) fe + 2 ' 


Note that 


pOO poo 

'ip(z 1 )= / 0*(t)e- (1+Zl)4 ^= / Ftye-te-^dt. 

Jo Jo 

Thus, the problem reduces to determine which in turn will give C ~ 1 {tjj (z)} 

and £ -1 {0(z)}. 


In view of C 


; 4 \ 

d k 

- t k+i e -*- 

1 (2 + zi) k+2 I 

dt k 

_ (As + 1)! _ 


, and by the definition of the 


cl 10 ( *1 

Laguerre polynomials L n (t) = — (t n e _t ) (see §1.3.1), we have £|e _2t L n (2t)j 

Let g(t)= e~ 2t [L k {2t) - L k+1 (2t)}. Then 


(2 + z 1 ) n + 1 ' 


9 00 = 


v k +1 


2 


{2 + z 1 ) k + 1 (2 + Zl ) k + 2 (2 + z\) k+2 ’ 

and in terms of the original variable z, this yields 

= (_1) ‘ e ‘ 2 ‘ [Lk(2t) ~ ii+l(2()1 


= (-0 k WkOti) - <t>l+ 1 ( 2 4 ]. where <^(i) = e *L fe (i). 


Hence, 

OO 

£ _1 {VT)} = E(~ 1 ) fe [^( 2 4 - <4+i( 2 4], 

k =0 

and the function 4>*(t) = <j)(t) — a e~ l = f(t) e~ at — a e~ l is given by 

OO 

P(t) = E(- 1 ) fe c * [^(2*) - ^fe+i(2i)] • (7.2.26) 

k=0 

7.2.5(b) Papoulis’ Method. (Papoulis 1956) Define 4> n (t) = e _t L n (t). 
Then 

poo §n 

<t>n{s) = £{<t>n(t)} = <t>n{t) e~ St ds = - - 
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The derivatives of 4> n (s) of order less than n vanish at s = 0. Thus, 
d k 4> n (s) 


ds k 


s =0 


POO 

(■-l) fe / t k 4>n{t)e~ st dt 

JO s=0 

pOO 

(— l) k / t k cj) n (t) dt = 0, k<n — 1. 

Jo 


Let f(t)= c k 4>k(t)- Then taking Laplace transforms on both sides, we have 

&=o 


/M = E 


OO r OO /■ i 7 \ 

E<* B-N t V + ” 


Cfe- 


(5 + l) /c+1 

fc=0 v 7 k= 0 L n=0 


Also, by expanding f(s) into a power series at s = 0, we get 

00 

/( s ) = sfe - 

k=0 


(7.2.27) 


(7.2.28) 


Comparing Eqs (7.2.27) and (7.2.28) and equating equal powers of s on their right 

k f k \ ^ f k\ 

sides, we find that \) k ~ n I ) c n , which gives ( . j 

n =0 ' j =0 

Since are known, we can find a finite number of the coefficients c&, which approx¬ 
imates f(t) by /tv(£) defined by 


N 

f n (t) = 

k =o 


(7.2.29) 


where Ck are defined by (7.2.17). 

7.2.5(c) Weeks’ Method. (Weeks 1966) Assume that the function f(t) 
satisfies the following integrability conditions: (i) J 0 °° e~ ct \f(t)\ dt < oo, and (ii) 
J 0 °° e~ 2ct \f(t)\ 2 dt < oo, whenever c > cq. Then the integral (7.1.1) defines a 
function f(s) which is analytic for > Co, and, by the Parseval theorem, both 

f(t ) and/(s) are related by / e~ 2ct \f(t)\ 2 dt = — / |/(c-Mo;)| 2 do;. Now, 

JO 27r J-ioo 

define a set of orthonormal polynomials (j) n (x ) = e~ x ^ 2 L n (x), n = 0, 1 , 2, ... , 
where L n (x) are Laguerre polynomials, and 0(0) = 1. Then a function f(t) can be 
expressed as an infinite series of the form 


f(t) = e ct a n 4> n 

n =0 



CL n 



e ct f{t) <j>n (t; 


dt. 


(7.2.30) 


Denote the partial sum of the first N terms in this series /at(^). Then /jv(£) will 
approximate f(t) if we take N sufficiently large and the decay factor c and the 
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scale factor T > 0 are chosen so as to accelerate the convergence. Also, f n (s) = 

POO 

/ /a(£) e~ st dt —» f(s) as N —» oo (Weeks 1966). Since 

Jo 

£{e ct 4> n (t/T)} = £{e ct -*/( 2T ) L n (t/T)} = {s ~°~ 1 /( 2T ))" 
we have 

N 

£{fN(t)} = fN(s ) = Y 


(s — c + l/( 2 T)) n+1 ' 
(s-c- l/(2T)) n 


n=0 


(s — c + l/(2T)) n+1 ' 


Thus, in view of Parseval theorem the function f(t) — /yv(t) is related to its Laplace 
transform f(s) — /n(s) by 


l 


OO 1 POO 

e~ 2ct \f(t) - f N (t)\ 2 dt = — I | f(c + ii]) - f N (c + ii])\ 2 dr], 


JO " ,l J —oo 

for c > Co. Hence, for any given £ > 0 there exists an integer N £ such that 

P oo 


1 

27r 


/ oo 

I f(c + iri) - Jn(c + irj)\ 2 dr] < e, 

-OO 


whenever N > N e . Let s = c + irj. Then 


N 


f{c+irj) « 


n=0 


(^-i/(2r) r 

'(^ + 1/(27)) 


n+1 ’ 


Since 


ir? - 1/(2T) 


I ij/ + 1/(2T) 
which we get 77 = — cot -. Then 


= 1 , we can define a 0 such that = — 


ie _iV- 1/(2 T) 


ir? + 1/(2T) 


, solving 


t r 

27 J_, 


/ 1 i 
V2T + 2 T 


cot 


0\ F / i 0\ 

2) f l C+ zT COt 2)-^ ane 

n =0 


in0 


d6 < e, 


whenever N > N e . This inequality implies that 


t it Q\ -( it 6 

— — cot — ) f ( c — cot — 

2 T 2 T 2 ) J V 2 T 2 


N 

■E 

n =0 


cue 


,m 0 


(7.2.31) 


Let us denote the real and imaginary parts of f(c + irj) by /#(c, 77 ) and //(c, 77 ), 
respectively. Then equating the real parts on both sides of Eq (7.2.31), we obtain 


1 

2 T 


, , 1 0 \ e F ( 1 e 

/fi ( C ’ 2 T C ot-j-cot-/Wc,-cot- 


A 


3? 


N 

{E 


n=0 


= a n cos nO = h(9), 


(7.2.32) 


n=0 
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where the coefficients a n are given by 


N 


N 


a 0 = 


N + l 




CL n — 


3=0 

_ . 2j + l \ 7r 
j ~ ' N + l) 2’ 


N+ 1 


V h(6j ) cos , n / 0, 


j=0 


(7.2.33) 


The interpolation formulas in Eq (7.2.33) are similar to those obtained by using 
Chebyshev polynomials. 

Although Weeks (1966) establishes the convergence of the series in Eq (7.2.30) for 
all positive T and for c > co, the convergence may be faster for some specific values 
of T and c. Based on the behavior of Laguerre functions L n (x), Weeks conjectures 
that /jv(£) should give a good approximation for f(t) for 0 < t < £ max , where 
tmax < 4 NT. A satisfactory choice of T is T = t max /iV. Theoretically, the smallest 
value of c to ensure the convergence of the series in Eq (7.2.30) is = Co such 
that the rightmost singularity of f(s) lies on the line 3i{s} = cq. However, Weeks 
(1966) determines empirically that a satisfactory choice of c is 

c — ( c 0 + 1/^max) U (Co + 1/^max) ? (7.2.34) 

where U(x) is the unit step function. To compute the coefficients a n in formula 
(7.2.21) we must determine h(6) at the (N + 1) values given in (7.2.22). Thus, 
we compute 

h ^ = ^ R c ^ _ % ^ ^ ’ 


, 1 07 • „ „ 

where r]j = — cot j = 0 , 1 ,. 

by the formula 


, N. The values of 77j are calculated recursively 


7 Vj-i -0 




rjj-i + 7 


j = 1 , • • 


,iV, 


where 7 = — cot ( 9 0 
given by 


1 COS 60 

2 T sin #o ’ d 


1/ (4T 2 ), and the starting value of 770 is 


1 6j 

Vo = - 7 ^ cot — = 
/u 2T 2 


1 1 + cos 6> 0 
2 T sin #0 


Once cos 0 q and sin #0 are computed, the other values of cos Oj and sin 6j are calcu¬ 
lated for j = 1 , 2 ,... , N, by using the recursive formulas 


cos 6j = a cos#j_i — (3 sin#j_i, 
sinOj = (3 cos#j_i + a sin#j_i, 
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where a = cos 26*0 = 2 cos 2 do — 1 and /? = sin 200 = 2 sin do cos 0o- Next, the 
values of cos nOj for n = 2, 3, ... , TV, are computed from the identity cos nOj = 
2 cos 6j cos (n —1) Oj — cos (n—2)0j. This completes the evaluation of the coefficients 
a n . Finally, the approximation /at(T) is computed from formula (7.2.19), where the 
functions 4> n (t) are obtained from the recurrence relation 

0 o(x) = e~ x/2 , 

0i(x) = (1 -x)0o(x), 

n<t> n (x) = (2n - 1 - x) </> n -i(x) ~ (n - 1) 0 n - 2 (x), n> 2. 


Example 7.2.3. (Weeks 1960) Consider f(s) = l/(s 2 + s + 1), with exact 
2 3t 

solution as f(t) = -e~ l l 2 sin —. Define 

O Z 


t 


e ,• 


Tin = - COt — = - 

13 2 T 2 2 T 


t (lT cos Oj 


sin On 


and use Eqs (7.2.32) and (7.2.33) and the definition of /at(T). Table 7.2.3 contains 
the values obtained from Weeks’ algorithm for N = 30. For computational details 
see weeks. nb on the CD-R. 


Table 7.2.3. 


t 

Exact 


.feo(t) 

0.0 

0.0 

7.88(— 8 ) 

—7.5(—10) 

0.5 

0.353907 

0.377345 

0.383849 

1.0 

0.403341 

0.533507 

0.513614 

1.5 

0.245024 

0.525424 

0.479157 

2.0 

0.034610 

0.419280 

0.358920 

2.5 

-0.109170 

0.274110 

0.214463 

3.0 

-0.145411 

0.133243 

0.086115 

3.5 

-0.099507 

0.022128 

-0.006185 

4.0 

-0.025210 

-0.049530 

-0.058397 

4.5 

0.031623 

-0.083449 

-0.076518 

5.0 

0.051331 

-0.087942 

-0.071111 

5.5 

0.039320 

-0.073722 

-0.053192 

6.0 

0.013679 

-0.050892 

-0.031747 

6.5 

-0.008259 

-0.027239 

-0.012717 

7.0 

-0.017710 

-0.007644 

0.000957 

7.5 

-0.015174 

0.005714 

0.008682 

8.0 

-0.006552 

0.012715 

0.011356 

8.5 

0.001736 

0.014511 

0.010544 

9.0 

0.005953 

0.012805 

0.007881 

9.5 

0.005731 

0.009302 

0.004699 

10.0 

0.002921 

0.005385 

0.001878 
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For c = 0, our values in the third column, and also obtained by Kythe and Puri 
(2002), using Weeks (1966) algorithm, matched Weeks’ values exactly; however, our 
values in column 1, obtained for the function f(t), do not match his values. However, 
our values are correct: Our first negative value for f(t) appears at t = 2.5; it is 
because sin(3t/2) \ t _ 2 5 is negative. It appears that the second column in Table 1 of 
Weeks’ article was accidentally replaced by his third column, since the two columns 
are exactly alike. The third column in Table 7.2.3 corresponds to Weeks’ algorithm 
with N = 60, and the values are generally closer to the actual values of the function, 
but not sufficiently accurate. Also, if we use formula (7.2.34) to determine c, then its 
value for t max = 10 should be 0.05. If we take this value of c, the values obtained 
from the algorithm are worse than those obtained for c = 0. 


Example 7.2.4. Weeks (1966) also considers the following examples: 

<“)/(») = T 


, for which f(t) = 1 — e l erfc (Vt); 


4 ^TT ’ for which m = 4 JoW; 


(iii)/(s) = - e 2 , for which f(t) = U(t — 25). We will consider one of these 
examples; the others can be computed similarly. 


Example 7.2.5. Consider the above example (ii). The results are given in Table 
7.2.5. 


Table 7.2.5. 


t 

/so (t) Weeks 

f 20 {t) Weeks 

Exact 

0.01906 

0.7843 

0.7811 

0.7853 

0.07654 

0.7847 

0.7871 

0.7842 

0.17334 

0.7797 

0.7804 

0.7795 

0.11012 

0.7660 

0.7621 

0.7665 

0.49188 

0.7390 

0.7352 

0.7386 

0.71921 

0.6872 

0.6865 

0.6871 

0.99743 

0.6015 

0.5983 

0.6019 

1.33258 

0.4738 

0.4679 

0.4736 

1.73287 

0.2980 

0.2967 

0.2976 

2.20970 

0.0823 

0.0836 

0.0824 

2.77932 

-0.1390 

-0.1376 

-0.1386 

3.46574 

-0.2950 

-0.2869 

-0.2947 


Garbow, Giunta and Lyness (1988) have modified the Weeks’ method as follows. 


Let c > cq and b > 0 be two parameters. Define g(s) 


b 

1 — 8 




— s 



)• 
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oo 

and let a n be the Taylor’s coefficient of g(s), i.e., g(s) = a n s n , |s| < r, where 

n =0 

r is the radius of convergence of this series, and r > 1. Then 

oo 

f(t)=e ct ^2a n <j> n (bt), c>c 0 ,b> 0 , 

n =0 

where (j) n (x) = e ~ x / 2 L n (x). Let /(£) be an approximation of f(t) by truncating 
the above expansion so that 


m— 1 

f(t) = eCt ^2 ®n<l>n(bt), 

n =0 

where the approximation a n of a n is given by 

1 m 

~ a n = - k E 9 (re 2 ^/ m ) e ~ 2 ^ m , l = 0,1,... , m - 1, 

rn r K z —' V / 

3 = 1 

where only m/2 + 1 distinct evaluations of g(s) are required since g (s*) = g*(s). 
Based on this algorithm, Giunta, Lyness and Murli (1988) have provided a software 
package, called WEEKS, for the inversion problem. This program requires the trans¬ 
form values at arbitrary points in the complex plane C and is suitable when / has 
contninuous derivatives of all orders; it works very efficiently when f(t) is required 
at a number of different values of t. As a test case they consider f(s) = 3/ (s 2 — 9), 
which has the inverse f(t) = sinh(3£). The results are given in Table 7.2.5a. 

Table 7.2.5a. 


t 

f(t) Computed 

f(t) Exact Error 

0.0 

9.93991(—08) 

0.0 9.9(—08) 

1.0 

1.00179(+01) 

1.001787(+01) 9.5.5(—07) 

2.0 

2.01713(+02) 

2.017132(+02) —1.5(—05) 

3.0 

4.05154(+03) 

4.051542(+03) 2.0(-03) 

4.0 

8.13774(+04) 

8.137739(+04) -3.9(-02) 

5.0 

1.63451(+06) 

1.634508(+06) -7.5(-051 


Garbow and Lyness (1990) have corrected some errors in the above WEEKS 
program. 

7.2.5(d) Piessens’ Method. (Piessens 1971) It uses the Laguerre functions 
as follows: 

oo 

f(s) = s~ a ^2 °k L k ibs ~ l ), 
k =0 
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which, after term-by-term inversion gives 

j-a—l °° 

fit) = p7-y ° k (7.2.35) 

^ ' k =0 


where 

4> k (x) = i F 2 (^ ^ a ;x 
To compute (7.2.35) we use the recurrence formula 

r3n 2 — bn + 2na — a + 2 d 


077, (^) — 


n(a + n — 1) 


n(a + n — 1) J 


0n-lO) 


(3n + a-4)(n-1) , ^ (n-l)(n-2) , ^ 


n(a + n — 1) 


n(a + n — 1) 


with the starting values 0_2(x) = 0_i(x) = 0 and 0o(x) = 1. The coefficients c& 
are computed by using Gauss-Laguerre quadrature rule (§4.3.8), but since (7.2.24) 
generally converges less rapidly, this method is useful only if the coefficients Ck are 
previously known analytically or computationally (§7.2.4). 

Some other authors who have used Laguerre polynomials are Shohat (1940), Ly- 
ness and Giunta (1986), Garbow, Giunta, Lyness, and Murli (1988a,b,c), and Giunta, 
Laccetti, and Rizzardi (1988). 

We will now discuss the general case. Piessens (1982) notes that convergence 
occurs for the class S 1 of the Laplace transforms f(s) = s -7 G(s), where 7 > 0 is 
known and G(s) is analytic at 00 , and also for the class S 7 j( 5 , defined in Cope (1990), 
where / (s) = s -7 G (s 6 ) , where 7 , 6 > 0 are known and G(w) is analytic at 00 . In 
problems of electrochemistry, 6 = 0.5 is a typical case. Thus, if f(s) G S 7 , where 

00 00 

f(s) is represented by f(s) =^a n s -fe-7 , then f(t) = ^ r / ^ \ t m+1 ~ l , 

k =0 m =0 

and the series converges for all t. Using the above Piessens’ method on the real line, 
if 

00 1 2a 

fi s ) = ^2 c ki (J ) s ~' y Pk^ -<7 < S < +OO, 

k =0 


then 

00 

fit) = ^2 Ck i a ) t7_1 M75 <7t )’ (7.2.36) 

k =0 

where </>& are the Jacobi polynomials on [—1,1 ]. Cope (1990) has proved that the series 
(7.2.36) converges for all t. The parameter a is left arbitrary in Piessens’ method, 
but since G(s) is analytic at 00 and 0 < 5 < + 00 , any positive value for a can be 
chosen. Also, the coefficients Cfc(cr) in formula (7.2.36) tend to zero exponentially 
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with respect to k and this exponential rate becomes slower as a decreases to zero. In 
practical implementation of formula (7.2.36) where only a partial finite sum is taken, 
only small values of a should be used, because such values will tend to simplify 
computational problems and allow us to calculate f(t) over a longer time interval 
0 < t < T. As before, the coefficients c& (a) are obtained by numerical quadrature. 
Cope (1990) has noted that although Piessens’ analysis is confined to the class S 7 
and S 7j $, computer evidence indicates that this method works well for a wider range 
of transforms f(s). 

7.2.5(e) Lyness and Giunta’s Method. As a modification of Weeks’ 
method, Lyness and Giunta (1986) use the approximation 

N 

fit) = e ct ^2 °‘ n e ~ t/(2T) L n (y), C > c 0 , (7.2.37) 

n =0 


with the error estimate 

E = e~ ct [f{t) - f{t) 

N 


^2 - a n ) e t/(2T) L n (Jj2) - "^2 a n e t/(2T) L n (Jj2), 


n =0 


n=N +1 


where the coefficients a n are defined in (7.2.19), and the coefficients a n are determined 
as follows. Consider a function 


9(z) = 


I 


(1 — z)T V (1 — z)T 2 T 

which is regular within a circle M< R, R > 1. Then 


c), 


d-n, — 


/ 


M. dz = 

2iir J z nJrl 27rr n 

C:\z\=r 


1 f 27r 

— / g(re i0 ) e~ in0 d9, n > 0. (7.2.38) 

rr " Jo 


where C is the circular contour which includes the origin but does not contain any 
singularity of g(z). This integral is approximated by using the m-panel trapezoidal 
rule, with m taken to be even. Define 

1 m 

aff l,1 \r) = - Y g ( re 2i7rj/m ) e 2i7rjn/m . 

r n m V / 

3 = 1 

Since g(z) is real when z is real, we have 

m/2 

a!T’ 11( r) = E [^{v ( re2W,/m ) } cos(2 t rjn/m) 


3 = 1 


jg e 2z7rj//m ^ | sin(27rjn/m) . (7.2.39) 
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Since g(z) has no singularities within the circle \z\ = r, we have, by Cauchy’s 
theorem, 



(7.2.40) 

After dividing this result by r 2n and then combining with (7.2.38) by taking sum and 
difference, we find that 



9(z) ( 1 + ; )dz 

z j =r z \z n r 2n J 



II 

to 

s 

n27T 

/ g (r e 2 °) cos n6 dO = < 

Jo 

j 

1 

n = 0, 

n > 0, 

Bn ~^l 

9(z) l l 

z j =r z \z n r 2n / 



II 

to 

s 

n27T 

/ g (r e 20 ) sin n6 d6 = < 

Jo 

r°> 

l , 

n = 0, 

n > 0, 


Thus, 2 a n = A n — i B n . Two approximations of the integral representation (7.2.40) 
for n = 0,1,... , m/2 are considered: one, by the m-panel midpoint rule gives 

c\ m 

4 m ’° 1( 0 = — ( r e M2j “ 1)/m ) cos ((2 j - 1)tt n/m) 

3 = 1 
m/2 

= ^E S {/ r j cos ((2i _ I),, n/m), 

3 = 1 

and the other, by the endpoint trapezoidal rule gives 

9 m 

4T’ 1] (r) = — cos(2tt jn/m) 

r 171 j = 1 
m/2 

= ^ K ( r e 2iOTi)/m ) } cos (2 t xjn/m). 

3 = 1 

Weeks’ method uses formula (7.2.37) with r = 1, N = m/2, and a 0 = ^ Aq 77 ’ 0 ^ (r), 
a n = Aj/ 7 ’ 0 ^) for n = 1, 2,... ,m/2 — 1, and a m / 2 = \ Lyness and 

Giunta’s method uses formula (7.2.37) with r = 1, TV = m — 1, and a n = A[T’^ (r) 
for n = 0,1, 2,... , m — 1. 

7.2.5(f) de Hoog’s Method, (de Hoog et al. 1982) This method is based 
on the computation of the Bromwich integral (7.1.2) by approximating it as 

fN(t) = Y®{^r + Y, f(c+ik*/T) e ik ^ T \, 

^ k= 1 ^ 
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such that 


fit) - hit) 


fN^t) 


< e, where £ is the preassigned tolerance. D’Amore, 


Lacceti and Murli (1999a) improve upon this method and use Rutishauser’s QD 
scheme to compute /n (t). They use a set of 38 test functions, which are available in 
the file 38TestFunctions .pdf on the CD-R. 


7.3. Use of Gaussian Quadrature Rules 

The following three methods are considered. 

7.3.1. Bellman-Kalaba-Lockett’s Method. (Bellman, Kalaba, and 
Lockett 1966) This method uses the Gaussian quadrature to compute inverse Laplace 
transforms. We set r = e _t , t = — lnr, and dt = —dr/r in (7.1.1). Then, taking 
/(—logr) = g(j), we get 

r 1 N 

/(s) = / r s_1 /(-logr)dr = y'c fe w) fe r^ _1 , c k =g(r k ) (7.3.1.) 
Jo k= 1 

Since w k ,r^~ l , and f(s) are known, this formula reduces to a system of N equations 
by choosing N values for s as s = n + 1, n = 0,1, 2 ,... , N — 1; then 

N 

f(n + 1) = ]Tc fc w k T k , (7.3.2) 

k =1 

which when solved for gives the values of g{r) for the N nodes. Using these values 
g (t) can be approximated by a polynomial of degree N — l. However, difficulty arises 
in the inversion of the matrix {wk rj} }, which is often ill-conditioned. Let the solution 
of the system (7.3.2) be 


N—l 

c k = g(Tk) = yUfcn fin + 1), 

n =0 

and let = Wk gijk) = Wk c^. Then this system reduces to 

N 

=a,i=f(i). 

k =i 

Denoting the elements of the matrix of this system by = t^ - 1 , i = l,2,... ,7V, 
multiplying both sides of this system by and adding them we get 

N , N x N 

y, Vk f 'Yjn i k Qi j = (7.3.3) 

k =1 ^2=1 ' 2=1 
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where qi are yet to be determined. Define l(r) = J2k=iQk r k ~ 1 ; then the system 

(7.3.3) becomes 

N N 

^2 Vk l{Tk ) = yNi q%- (7.3.4) 

k= 1 2=1 

Now we choose qi in such a way that only one of the unknowns yk remains in Eq 

(7.3.4) and the coefficients of the other unknowns become zero. This requires that 
we choose N values for q i9 which we denote by qij. Then define 

N 

l A T ) = 

k =1 


and choose qkj such that 


lj{T k ) 


0 if k ^ j, 
1 if k = j. 


We can determine such qkj, because lj(r) is a polynomial of degree N — 1 , and 
therefore it satisfies N conditions. Once qkj are determined, we find from (7.3.4) 

that yi = J2k=i a k Qki, or g(n) = Jjk=i W t ak 

Example 7.3.1. f(s) = 2 ^ , f(t) = sinf. We use Pg(x), which has 

s +1 

zeros Xi and the modified weights w\ as given in Example 1.3.1. Then the system of 
equations (7.3.2) is given by 


f(n + 1) = (0.0406376) (0.01592)”ci + (0.0903246) (0.0819845) n c 2 

+ (0.1303056) (0.193314)"c 3 + (0.1561712) (0.337874)”c 4 
+ (0.1651198) (0.5) n C5 + (0.1561712) (0.6621265)"c 6 
+ (0.1303056) (0.806686)"c7 + (0.0903246) (0.9180155) n c s 
+ (0.0406376)(0.98408) n c 9 for n = 0,1,... , 8, 


and we obtain 

Ci = {- 0.555427, 0.531849, 1.0262, 0.867557, 0.650197, 0.392641, 
0.219162, 0.0810746, 0.018805}, i = 1, 2,... , 9. 

Thus, the function f(t) = /(— \nx) = g(x),g(x\) = q is known at the nine points 
Xi . Further, if we assume that 


9 

d( x ) = 

k =1 
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then we can obtain nine equations by letting x = Xi for i = 1, 2,... , 9, and solve 
for Bfr, which are given by 

B k = { -0.5554273121669501,0.5318493617139866,1.0262029177215746, 
0.8675569112458106,0.6501966073073655,0.39264073646123254, 
0.21916193172192688,0.08107463934338578,0.018805014457441416}. 
Now, fit) can be approximated by 

fit) = -0.953120649827127 + 26.85593411635183e“* 

- 120.02973389488155e“ 2t + 133.11599313846204e“ 3 * 

+ 511.05194566693484e“ 4t - 1962.8192889883146e“ 5 * 

+ 2790.690732420141e“ 6t - 1864.0777367913424e“ 7 * 

+ 486.19656491268586e“ st . 

Table 7.3.1 gives the values of sin t and above approximate solution fit). For com¬ 
putational details see bellman. nb on the CD-R. ■ 


Table 7.3.1 


t 

Exact 

Kt) 

Error 

0.0 

0.0 

0.0312 

3.1(—2) 

0.5 

0.479426 

0.48193 

2.5(—3) 

1.0 

0.841471 

0.825406 

1.6(—2) 

1.5 

0.997495 

1.01933 

2.1(—2) 

2.0 

0.909297 

0.910953 

1.6(—3) 

10.0 

-0.544021 

-0.951902 

7.8(—3) 


Example 7.3.2. f(s) = —-—, /(f) = e“*. 

s 1 

Following the steps of in Example 7.3.1, the approximation for e -t corresponding to 
(7.2.29) is 

/(f) = -(5.400809667158862) 10“ 6 + 1.0005081843971176“* 

- 0.011280122194696447 e“ 2t + 0.09671775139664975 e“ 3 * 

- 0.399801991834753 e“ 4t + 0.8833083132385336 e“ 5 * 

- 1.067983373238557 e“ 6t + 0.6661710928983806 e“ 7 * 

- 0.1676435041570735 e“ 8 *. 

Table 7.3.2 gives the values of /(f) = e“* and the approximate values /(f) obtained 
from the above approximation. For computational details, see be liman, nb on the 
CD-R. ■ 
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Table 7.3.2 


t 

Exact 

m 

Error 

0 

1.0 

0.999991 

9.0(—6) 

1 

0.367879 

0.367883 

4.0(—6) 

2 

0.135335 

0.135332 

3.0(—6) 

3 

0.0497871 

0.0497887 

1.6(—6) 

4 

0.0183156 

0.0183163 

7.0(—7) 


Some improvements to this method are as follows: 

7.3.2. Felts and Cook’s Method. (Felts and Cook 1969) If we make a 
change of variables t = — In (x/T) in (7.1.1), we obtain 

/(s)= f i (?)’ lf (- ia (f)) dx ' (7 - 3 ' 5) 

which can be expressed as the sum of two integrals 

/W = f(i 7r,J© = + 


We will make change of variables in 7i and 1 2 so that the interval of integration in 
each is changed to [0,1], which will permit use of the Gauss-Legendre quadrature 
formula with the shifted Legendre polynomials A* (A Thus, in I\ we set x = Ty/2 
and in / 2 set x = T(y + 1)/2. Then 


/(*)=2 


Cr'A- ©)* 


(7.3.6) 


If we apply Gauss-Legendre quadrature to each of the integrals in (7.3.6) and allow 
s to take 2N real values s = k + 1, k = 0,1,... , (27V — 1), then we obtain 


f(k + 1 ) 



Ana 



A) 


* = 0,1,... , (2JV - 1), 
(7.3.7) 


in which the two matrices within square brackets are to be computed. 
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A generalization of formula (7.3.6) from two integrals to an arbitrary number m 
of integrals is obtained by expressing the integral (7.3.5) as the sum of m integrals 


f( s ) = 


m 


(m-i+l)/T 
m—i)/T 


(fO ( ? - 3 - 8 ) 


T 

where the intervals of integration can be transformed to [0,1] by setting x = — y + 

rri 

(rn — i)T 

-. Then (7.3.8) becomes 

m 


m 



iy _1 f(— i n (v_ 

m / V \m 



(7.3.9) 


Applying the quadrature approximation to the m integrals in (7.3.9) and letting 8 take 
on the real integral values s = fc + l,fc = 0,1,... , (mN — 1), we obtain 


.. m N 

f(k + 1 ) = -EE[^ Xj) k ]f{- In (*«)), (7.3.10) 

1=1 j = l 


y . JYI — % 

where = — H-. Formula (7.3.10) has an (mN) x N matrix which must be 

m m 

computed for each of the m integrals. Note that for m = 2 formula (7.3.10) reduces 
to (7.3.7). 

Felts and Cook (1969) have computed tables for f(k +1) for m = 1 and N = 32, 
m = 2 and N = 16, and m = 4 and N = 8, and compared the results with the exact 
values of f(s) at the points for the function 

p / x _ a i s + a o 

l( s b) 2 + d\\ [(s + c) 2 + d|] ’ 

for ao = 16, a\ = 32, b = 1, c = 3, di = \/l5> and ^2 = \/27- These computed 
values are used in the Gauss-Legendre formula developed by Bellman, Kagiwada and 
Kalaba (1965), although they can be used in any one of the above Gauss-Legendre 
formulas, say (9.1.7), to approximate f(t). 

7.3.3. Piessens’ Method. (Piessens 1969a) starts with summarizing the 
method of Bellman et al. (1966) by applying the Gauss-Legendre quadrature rule to 
(7.3.1), which gives 

N 

f(s ) « Wi T i ~ 1 f U ln U ’ 

2 = 1 

where u is the i -th zero of the shifted Legendre polynomial P^( x ) and Wi is the 
corresponding weight. If we let s assume N different values, e.g., s = 1,2,... , N, 
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we obtain a system of TV linear equations in TV unknowns / (— In Ti), i = 1,2,... ,7V, 
which can be solved explicitly to yield 


N 

( 7 - 3 - n ) 

fc=i 

where ti = — In 7 $, and the coefficients are tabulated by Bellman et al. (1966). 
The drawback with the inversion formula (7.3.11) is that it gives values of f(t) in a 
restricted number of nonequidistant points. Piessens (1969a) has modified formula 
(7.3.11) by approximating /(s) by an interpolating rational function 

N 

N (k + N- 1)! ( s-m) 

m = E(- 1 ) JV_fc --> ( 7 - 3 - 12 ) 

k=1 [(k — 1)\] (N — k)\ n (s + m) 

m =0 

which is a generalized Lagrange interpolation polynomial in the points 8 = 1, 2,... ,7V. 
Inverting (7.3.12) we obtain the formula 

N 

f(t) « ^fc V) ( e_ 5 /W) (7.3.13) 

fc = l 


where (j)^ 


(x) is a polynomial of degree TV 


1 , defined by 


c 


N 


M = E TTirr 


(-i) 


/c+m—1 


(TV + & — 1)! (TV + m)\x 71 


^ [(k — l )!] 2 (TV — k)l (ml) 2 (TV — m — 1)! (k + m) ’ 


(7.3.14) 


The coefficients of (j)^\x) can be easily computed (see coeff s .nb on the CD-R). 
Piessens (1969a) has provided a table of these coefficients for TV = 3(1)7, which 
is presented as Table A.30. Using these values of the coefficients he computes two 
tables of the values of (j)^ (e _t ), one for TV = 6 and t = 0.0(0.5)7.0, and the other 
for TV = 10 and t = 0.0(0.5)10.. 

Piessens (1969c) considers the integral (7.1.2) which, after setting st = u and 
assuming f(s) = u _1 G(u ), where 7 is a parameter, yields the approximation 


tf(t) 



e u u 1 G(u)du 


N 


E G (Uk) , 

k=1 


(7.3.15) 


where V is the line {u : ^R{u} = ct }, Ak are the weights and Uk the nodes (both 
complex quantities). Formula (7.3.15) is the TV-point Gauss quadrature formula and 
is called the Gat- rule. This formula has a number of shortcomings, namely, (i) there 
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is no procedure to determine N a priori for a desired accuracy, which leads to using 
this formula successively with increasing order and finding an agreement between 
two consecutive approximations to desired accuracy; (ii) this procedure then uses 
different values of nodes of different order in each approximation; and (iii) when 
N is large, the weights also become large, which leads to considerable cancellation 
errors. To avoid these shortcomings, Piessens (1969c) has developed the following 
approximation: 

tf{t) = — : / e n u~ 1 G(u)du « ^2B k G(u k ) + ^ C k G(v k ) , (7.3.16) 

171 ’’ U k= 1 k= 1 

where Uk are the nodes of the Gat- rule (7.3.15), such that the precision in (7.3.16) 
is maximum. Formula (7.3.16) is a 2N + 1-point Gauss quadrature formula and is 
called the G* N - rule. The nodes Uk, k = 1, 2 ,... , N, are the zeros of the polynomial 
in P/v (1 /s) defined by 


P N (l/s) = (-l) N e s s N+ 1 1 ^ 7 ( ^- 1 ). 
or 

PnO-/s) = (-1) n 2 F 0 (-N, N + 7 - 1; 1/s). (7.3.17) 

These polynomials are such that — f e s s~ 7 Pn(1/s) s~ r ds = Oforr = 0,1,... , 

J 

N — 1. Now, the orthogonality property of the polynomials implies that there also 
exists a polynomial Q^(l/s) of degree K such that 


1 

2iir 


L 


e s s 7 Pn(1/s) Qk(1/s) s r ds = 0 


for r = 0,1,... , K — 1. 


(7.3.18) 

The weights B k and G^ in formula (7.3.16) can be determined so that the degree of 
precision in this formula is + 2 K — 1 , provided that the nodes Vk are the zeros of 
the polynomial Qk( 1 / 5 )• To determine the polynomials Qk( 1 /s), we first calculate 
the moments for the case 7 = 1. Thus, the r-th moment is 


M N , r 


1 

2i7T 


L 


e s s 1 Pn(1/s)s r ds. 


(7.3.19) 


where M/v, r = 0 for r = 0,1,... , N — 1, and 




(-1) n (N + k)l 
k\ (2N + fc)! 


for k = 0 , 1 , 2 ,.... 


If we set 


Qk0-/s) 


1 OjK-1 


CL\ 

- 1 " CLQ ■> 


s 


(7.3.20) 


(7.3.21) 
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and substitute this into (7.3.18), we find that there exists a solution only if K is at 
least TV -b 1. Hence, we will take K = TV + 1. The coefficients a^,k = 0,1,... ,7V, 
in (7.3.21) are computed recursively by 


<2n = 


m N jN+1 

Mn,n 


&N-k = — 


MN,N+k +1 + MA,A+fc &N + • • • + 7lfjv,A+l R/V-A+1 
iwr ’ 


for k = 1, 2,... ,7V, 




which, in view of the definition (7.3.19) yield the recursive formula 


dN = — 


7V + 1 
27V + 1’ 


R/v-/c — — [CW,fc+i + ajv + • • • + Cat a N-k+i] ? k — 1 , 2 , ... , TV, 

(7.3.22) 


where 

= = (TV + 1)(7V + 2)... (7V + i) 

N,i M NtN (2N + l)(2N + 2)...(2N + i)i\‘ 

The additional nodes Vk in the new G * N -rule (7.3.16) are the zeros of Q jv+i (1/ s), 
and the weights Bk and Ck are given by 

(-l)"(2N-l){N-l)l 
k P N -\ (1/iLk) Qn+i (l/^fe) (2iV)! fe ’ 

A (-1) JV+1 (27V-1) 2 
fc TVw 2 [A-i(lK)] 2 ’ 

fe Piv (1/Ufe) Qjv + 1 (VM ( 2Ar )!’ 

where the prime denotes the derivative with respect to 1/s. The weights 77/,. are 
almost as large as but Ck are much smaller than A k . Thus, the round-off error 
in both Gat- rule and the new G%- rule is almost the same. The nodes and weights of 
the G* n - rule for TV = 2(1)12 are available in Table A.31 (Piessens 1969c). 

Several authors have tabulated tables of the weights A k and the nodes u k . For 
example, Salzer (1955) gives u k , their inverses, and the products u k A k to between 
4S* and 8S for TV = 1(1)8 and 7 = 1; Salzer (1961) gives the same quantities 
to between 12S and 15S for TV = 1(1)16 and 7 = 1; Krylov and Skoblya (1961) 
give A k and u k to 5S to 7S for TV = 1(1)9 and for values of 7 which are integer 
multiples of \ and | between the limits \ and 3; in 1969 they also give A k and 

*Here S stands for ‘significant digits’. 
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u k to 20S for N = 1(1)15 and 7 = 1(1)5, and to 7S to 8 S for N = 1(1)10 and 
7 = 0.01(0.01)3.0; Skoblya (1964) gives u k to 8 S andA k to 7S for N = 1(1)10 and 
7 = 0.1(0.1)3.0; Stroud and Secrest (1966) give u k and A k to 30S for N = 2(1)24 
and 7 = 1 ; and Piessens (1969b) gives u k and A k to 16S for N = 6 ( 1)12 and 
7 = 0.1(0.1)3.0, 3.5,4.0, - 


10 1 3 

3 ’ 4 ’ 4 ’ 


1 

9 * 


Example 7.3.3. Piessens (1969c) considers f(s) = 


Vs 1 2 + 1 


for which 


f(t) = Jo(t). The result obtained from both Gn and G* N rules are given in Ta¬ 
ble 7.3.3. It is obvious that the accuracy increases for the G * N -rule with larger N. 


Example 7.3.4. Piessens (1971) considers f(s) 
indicial function 


e W* 

—which has the 
V* 


f(t) 



V / 4t J 0 ( 2 xAI) du. 


Using the approximation 


nt) 


Vi 




( 0 . 5 )\ 


- A 


(1.0) 


GaO 


,(!-0h 


k =1 


where G\{x) = cosh \ftjx and G^ix) = \Jx/1 sinh y/t/x, and using the values 
o f A and V k a) from the tables given in Piessens (1969b) for 7 = a and N = 6 , 
this example is solved numerically and the results are available in Piessens (1971). ■ 

Table 7.3.3. 


t G 5 G^ Gg Gg Exact 


1 0.76518 0.76519 

2 0.22389 0.22390 

4 -0.39701 -0.39718 

6 0.13883 0.15068 

8 0.21100 0.16728 

10 -0.07542 -0.19675 

12 


0.76525 

0.76519 

0.22403 

0.22405 

-0.39732 

-0.39722 

0.15104 

0.15077 

0.17162 

0.17160 

-0.24436 

-0.24579 

0.02722 

0.04762 


0.7651976865579666 

0.2238907791412356 

-0.3971498098638473 

0.1506452572509970 

0.1716508071375542 

-0.2459357644513483 

0.0476893107968335 


7.3.4. Kajiwara and Tsuji’s Method. The polynomials pn (0, defined 
by (7.1.5), are used to approximate f(s) by using the Clenshaw-Curtis quadrature 
rule (§3.3.1). Since the polynomials Pn(€) oscillate with larger amplitudes as the 
value of N increases, Kajiwara and Tsuji (1995a) use the technique of changing them 
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to the logarithm by setting 


A(n, k) = In 


(2 n)\ 


(n + 1)! k\ (n — k)\ (n + fc)! 

2 n 2+1 k n—k n-\-k 

= (E-E-E-E-E 


i=l 


i=1 


i=1 


i=1 


i=1 


In j. 


(7.3.23) 


Then the polynomials pn(\) are computed from 


Pn(£) 


E (-V + 1 

0 <k<n<N 


exp 


fA(n,k)\ f £ 

l+++) exp l 7+7 



n-\-k 


X 


r 2n T 1 2 / 1 

ln + fc + 1 Vn-f/c + l 


+ 3n + l \, + n{n + k + 1)1. 

7 (7.3.24) 


The inverse /(s) is then approximated by the inverse Laplace transform of /yv(T), 
which is written as 

/»00 I /‘QG 

/tv(<) = / f(s)e~ st p N (st)ds= - / f(s/t)e~ s p N (s)ds. (7.3.25) 
70 ^ 70 

The round-off error caused by addition is estimated by taking T>o = 0, 

= e M max {|a+ |p+ |pj-i} + <+-i, 


where cm is the machine precision; the index j stands for the j -th pair in order of 
(n, k) = (N, N), (N,N — 1),..., (N, 0), (N- 1, JV-1), (JV-1, iV-2), ...,(1,1), 
(1,0), (0,0); the quantities a/~ are the computed values of 


(—l) fc+1 A(n, k) | 


2n + 1 
n + k + 1 


s 2 - 


( 277/ + 1 \ T 

---- + 3n + 1 I 8 + n(n + fc + 1) h 

n + fc + 1 7 v 'J 


andpo = 0, pj = pj-\ + dj for j = 1(1)M, where M = (TV + 1)(7V + 2)/2. The 
values of pm are computed for s = 50 and TV = 40, which are presented in Table A.32. 
Neglecting the truncation error e(t), the round-off error is computed by 6(s, t) = 

8m(s) — the error due to the oscillation of the polynomials pn is controlled 

by D = yj / 0 °° S(t) 2 dt , where 6(t) = J 0 °° 6(s, t ) ds + e(t). The transformation of 
/n (A), given by (7.3.25), enables fast storage of the computed values of pn(s)- The 
Clenshaw-Curtis rule is used to compute the approximate values of /n (t). Kajiwara 
and Tsuji (1995b) have provided a Fortran77 program to compute Pn(s) using an 
algorithm that eliminates round-off errors of addition and multiplication. Some results 
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are given in Table 7.3.4, where Gn = y / 0 °° | f(t) — /tv(^) | 2 dt , and the total error 
is the sum of D and the truncation error. 

Table 7.3.4. 


N 

/n(1 ) 

Gn 

D 

Total Error 

10 

0.13863534 

2.91735(—02) 

6.551(—12) 

4.083(—05) 

20 

0.14899286 

1.74395(—02) 

2.016(—09) 

5.939(—05) 

30 

0.15301003 

1.24817(—02) 

1.118(—06) 

7.226(—05) 

35 

0.15420178 

1.09448(—02) 

2.143(—03) 

2.146(—03) 

36 

0.15490459 

3.80202(—02) 

7.384(—03) 

7.563(—03) 

38 

0.14087664 

— 

— 

— 

40 

0.84248827 

— 

— 

— 


7.4. Use of Fourier Series 

A Fourier series representation of an unknown function f(t) can be used effectively 
for numerical evaluation of the function f(t). We discuss the methods of Dubner and 
Abate (1968) and Durbin (1974). 

7.4.1. Dubner and Abate’s Method. Setting s = c + iuj in (7.1.1), we 
get 

pOO 

/ e-^^mdt = m, 

Jo 

whose real and imaginary parts 

pOO poo 

^{f( s )} = / e~ ct f(t) cosoot dt, ^{f( s )} = — e~ ct f(t) smoot dt, 

Jo Jo 

are known as the Fourier cosine and sine transform of f(t), respectively. Note that 
a > ao, where ao is a real constant such that all singularities of / (s) lie to the left of 
= ao. Using the Fourier inversion formula we obtain 

o p ct r°° _ op ct 

f(t ) =- / 3ft{/(s)} cos out duo =-/ $s{f(s)} sin uotduo. (7.4.1) 

71 Jo 71 Jo 

Thus, the problem reduces to numerically evaluate either of the integrals in (7.4.1). 

Consider a real function h(t) such that h(t) = 0 for t < 0. Divide the interval 
[0, oo) into subintervals of length T, where the n-th subinterval is (nT, (n + 1)T). 
The entire range [0, oo) is covered as n —» oo. Consider the function h(t) in the 
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interval ((n 
such that 


1)T, (n + 1)T), and define even periodic functions g n (t) of period 2 T 



M*) 

h(2nT — t) 


if nT < t < (n + 1)T, 
if (n — 1)T < £ < nT. 


(7.4.2) 


After replacing t by nT + t on the right side of (7.4.2), we have for even values of n 



h(nT + 1) 
h(nT — t), 


ifO <t< T, 
if-T < t < 0; 


and for odd values of n 



h((n + 1 )T — t) 
h{(ji + 1 )T + t) 


if 0 < t < T, 
if -T < t < 0. 


Thus, the Fourier series for each g n (t) is 


9n{t) 


A n , 0 
~Y~ 


oo 

+ COS (o; fe i), 

k =1 


cj/c = fc7r/T, 


where 


A n ,k 


or 


Thus, 


/ q T h(nT + x) cos (cjfct) dx for n = 0, 2,4,... , 

T + 1)^ — t) cos H*) for n = 1, 3, 5,... , 

2 /*(n+l)T 

A n ,fe = — / h( x ) cos (^fc<) dx. 


n=0 


2 A(cjo) 
T 2 


oo 

+ cos Ukb , 

fc=i 


(7.4.3) 


where A(uok) = cos Uktdt. If h(t) = e~ ct f(t), then Eq (7.4.3) represents 

the Laplace transform of the real-valued function f(t) with the transform parameter 
s = c + icjfc. This implies that A(uok) = Then, multiplying both sides of 

Eq (7.4.3) by e ct , we get 


°° 2p ct r 1 - °° _ i 

E] eCt 9n(t) = — |^2^{/( c )} + X! ( c + } cos • (7.4.4) 

n =0 fc=l 


Since the first term in the sum on the left side is e ct go(t) = f(t) in the interval 

oo 

0 < t < T, the rest of the terms y^e ct g n (£) represent the error which in the interval 

n =1 
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(0, T) is given by 


E = e ct g n (t) = e ct [h(2n + t) + h(2n — t)] 

n =1 n=l 

oo 

= £ e~ 2cnT [/(2n + i) + e 2ct f(2n - t)]. 

n =1 


(7.4.5) 


If we apply the trapezoidal rule to Eq (7.4.1) with step size i r/T, we obtain the 
approximation 


fit) 


2e ct 

— 


OO 

^{/( c )} + El^{7(c + «w fe )} cos u k t 
1 


(7.4.6) 


Note that the above error estimate depends not only on the step size but also on c 
which can be chosen appropriately in order to minimize the error. The error can be 
made reasonably small only for t < T/2. Thus, formulas (7.4.3) and (7.4.6) compute 
C~ 1 {f(s)} to a desired accuracy in the interval (0, T/2). In fact, since c is chosen 
such that no singularities of /(s) lie to the right of $7 {s} = c, we will assume that 
no singularities of f(s) lie to the right of the origin, which is always possible by a 
translation of the origin and an adjustment to / (s ). Let us assume that / (t) is bounded 
by some function of the type Ct m , where C is a constant and m is a nonnegative 
integer. First, we consider m = 0; then from Eq (7.4.5) we have 


error = E 1 <C e c{t ~ T) 


cosh ct 
sinh cT 


Clearly, the error becomes large as t —> T. Therefore, we should limit the use of 
formula (7.4.6) to the interval (0, T/2). Then the error in this interval is restricted to 
C e -cT//2 . Also, if f(t) < Ct 771 for m > 0, then the error in the interval (0, T/2) is 
bounded by 


Ei < C e~ cT t 2 


cosh cT/2 
sinh cT 


C (1.5T) m e -cT . 


Thus, this method reduces to the following steps: First, determine the interval for 
which the evaluation is needed, say, 0 < t < t \; then take T = 2t\, and determine a 
from (7.4.5) so that the error is within tolerance. 


Example 7.4.1. Consider /(s) = 


for which the exact solution is 


f{t) = 


= 2 


a/3 


sin V3t/2. Table 7.4.1 presents exact values f(t) (column 2) and 


approximate values from formula (7.4.6) using f(s) (column 3, for cT = 8, T = 20, 
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by taking the first 2000 terms in formula (7.4.6). ■ 

Table 7.4.1 


t 

m 

Exact 

t 

m 

Exact 

0.0 

0.0000 

0.0020 

1.5 

0.5254 

0.5254 

0.5 

0.3773 

0.3773 

2.0 

0.4193 

0.4193 

1.0 

0.5335 

0.5335 

10.0 

0.0054 

0.0054 


Example 7.4.2. Consider /(s) = — for which /(t) = sin A Table 7.4.2 

s I 1 

gives exact values for f(t) (column 2) and approximate values from formula (7.4.6) 
using f(s) (column 3). If we use the same values of a and T as in Example 7.4.1 
with the first 2000 terms, then the error, according to formula (7.4.5), appears in the 
fourth decimal digit near Tj 2. Note that the function f(t) converges very slowly. ■ 


Table 7.4.2 


t 

m 

Exact 

t 

m 

Exact 

0.00 

0.0000 

0.0020 

1.50 

0.9974 

0.9974 

0.25 

0.2474 

0.2474 

1.75 

0.9839 

0.9839 

0.50 

0.4794 

0.4794 

2.00 

0.9092 

0.9092 

0.75 

0.6816 

0.6816 

4.00 

-0.7568 

-0.7568 

1.00 

0.8414 

0.8414 

9.00 

0.4121 

0.4120 

1.25 

0.9489 

0.9489 

10.00 

-0.5440 

-0.5443 


7.4.2. Crump’s Improvement. This method is an improvement upon the 
above Dubner and Abate’s method; it uses both Fourier cosine and sine series, requires, 
besides the transform function itself, only the cosine, sine and exponential functions. 
It differs from the Dubner and Abate’s method in two respects: (i) The Fourier series 
contains additional terms involving the sine function selected in such a manner that 
the approximating function is less than the approximating function (7.4.6) and that 
the Fourier series approximates the original function f(t) on an interval of twice the 
length of the interval taken in (7.4.6); and (ii) Crump’s method uses a transformation 
of the approximating series into one that converges very rapidly. 

Crump (1976) has proved the following result: Fet f(t) be a real-valued function 
which is piecewise continuous for t > 0, and of exponential order a. Then the 
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function f(t) is defined by (7.4.1), and for c > a, 0 < t < 2T, we have 


nt) 


a ct 


T 


_ oo 

\ f( c ) + E 

3 = 1 


&/(c + 


jin 

T 


jwt\ 
’ T ) 




— e 


ct 


Y {e~ c{2nT+t) f{2nT + t)}. 
n=l (7.4.7) 


For proof, define a function k n (t),n = 0,1, 2,..., such that k n (t ) = e _ct /(£) for 
2nT < t < 2(n + 1)T, and elsewhere k n (t ) is a periodic function of period 2T. 
Then the Fourier series of k n ( t ) is 


k n (t) — \ A n , 0 + £ 

j=l L 


00 r „ jftt • JTtt 

An,j cos T B n ,j sin ^ 


T J’ 


where 


1 p2{n-\-l)T ■ , 

-Uj = r e ~ Ct fit) COS — dt, 

1 J2nT 1 

1 /*2(n+l)T - I 

- e -<* f(t) sin 3 —dt. 

1 J2nT 1 


Bn,j — rj~i 


Thus, 


E kn (4 = E [5 + E {Ai,j COS sin . 

n= 0 n=0 J —1 


. jnt' 


n =0 


(7.4.8) 

(7.4.9) 

(7.4.10) 


Substituting (7.4.8) and (7.4.9) into the series (7.4.10), we find after inverting the 
order of summation that 


yi kn(t) 

n =0 


1 

2 T 



f(t) dt 


OO OO r 


^EE 


r 2(n+l)T 
!2nT 

— ct 


e ct fit) cos J -7jrdt\ cos^t 

j=1 n=0 L ^ ^ 1 ' 1 

2(n+l)T . . jnt ,1 . j7rf' 

e /(i) sin — dU sin — 


il 


j = l 


2nT 

oo 

„—ct 


fit) dt 


jnt 


e ct f(t) cos 4— dt cos 


jnt 


l 


jnt 


+ e c fit) sin ; 7 — dt sin 


jirt 


(7.4.11) 
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Substituting for the integrals in (7.4.11) from the definition of Fourier cosine and sine 
transforms of /(t), we get 


= J,\\fi c ) + E jW( c + 

n=0 ^ 3=1 ^ 


J7TI\ jnt 

c + —— cos —— 
T ) T 


jm\ . jirt\ 


(7.4.12) 


Since 


£ k n (t) = e~ ct f(t ) + J2 e _c(2nT+t) f(2nT +1 ) on [0,2T], 


n=0 


n=l 


we find, on comparing this to (7.4.12) that 


oo 

e _ct fit) + e~ c{2nT+t) /(2nT + 1) 

n =1 


1 

T 


U(c) 



jnt <> E 
cos — - 3 / 




which, after solving for /(t) for 0 < t < 2T, yields /(t) = /*(£) — i?, where the 
/*(£) is the approximate solution 


/*(*) 




T 


oo 


i /( c ) + E 

i=i 



and E the error, given by 



(7.4.13) 


E = e ct e~ c{2nT+t) f(2nT + t). (7.4.14) 

n =1 

The approximating formula (7.4.13) for the integral (7.1.1) is essentially a trapezoidal 
rule approximation. 

Ignoring the round-off error, there are two sources of errors in Crump’s formula 
(7.4.13): (i) the Fourier coefficients used in the Fourier series for ko(t) are only 
approximations obtained by using f(s ); and (ii) there is truncation error since the 
series in (7.4.13) are not summed to infinity. The error bound is given by 

E < M e ct E 2 T(c-a) _ 0<t<2T. (7.4.15) 

If we choose a sufficiently larger a in (7.4.14), the error E can be made as small 
as desired. If, e.g., in applying formula (7.4.13) we want convergence to at least 4 
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significant digits, we must require that the relative error Er = ( E/M)e at < 0.00005, 
which means that we can replace (7.4.14) by E < M e at e - 2T ( c ~ a ) for 0 < t < 2 T. 

There are three cases of instability: (i) If the error is at t = 0, it is usually 
due to a discontinuity in the Fourier series expansion for ko(t) at t = 0, which is 
fco(0) = \ {/(0) + /(2T) e 2cT }. Hence from (7.4.13) and (7.4.14) we find that 
/*(0) - \ /(0) = E + \ f(2T) e~ 2cT < Me- 2T ( c - ft ) + ^Me- 2T M = § £. 
Thus, at t = 0 formula (7.4.13) approximates \ /(0) rather than /(0) with an error 
bound 50% greater than that for t > 0. (ii) If the error is at a value of t close to zero, 
the error bound (7.4.15) provides an algorithm for computing f(t) to a predetermined 
accuracy; and (iii) if the error is at extremely small values of t, which deviate from 
the exact value, the instability is due to the situation where the approximation f*(t) 
approaches \ [/(2T) + /(0)] instead of the Fourier series converging to ko(t) at the 
points of discontinuity under the condition f(t) = \ [/(£+) + /(£—)]. Some of the 
following examples clearly exhibit such an instability. 

Example 7.4.3. Crump (1976) considers the following four transforms: 

0) Ms) = -— 5 -t } - - for which f(t) = e* cos t - 1 ; 

(.S — 1 Y + 1 s 

(ii) Ms) = ^ - for which f(t) = 2 - e _t ; 

(iii) M s ) = (7 - -%) e_5s > for which /(*) = { °’ , , ! 

\s s + 1 / ( 2 — e , t > 5 

(iv) f 4 (s) = g2 + g + x ’ for which /(4 = ^ e ~ t/2 sin 

Both Euler transformation (ET) and e-algorithm (EPAL) are used for rapid con¬ 
vergence (for ET and EPAL see algorithms.pdf on the CD-R). As a result of 
computation of these inversions by formula (7.4.13) Crump has found that 

In (i) the Euler transformed series converges faster than the untransformed series, 
but EPAL gives more uniform accuracy. 

In (ii) smaller values of T improve convergence for small t but show the opposite 
effect for large t. Convergence is usually the best for t near T. One must take 
2 T > t max in order to control the relative error, and if 2 T is too close to t max 
convergence is very slow for larger values of t. The best choice of T appears to be 
7.5 for relative error of 10“ 8 , and 6 for relative error of 10 -4 . Generally, the smaller 
T is, the smaller the relative error is. 

In (iii) EPAL makes convergence faster and gives the best results. The computed 
values confirm the predicted perturbation in the neighborhood of the discontinuity at 
t = 5, which is due to the Gibbs phenomenon. This discontinuity can be removed by 

inverting /jT(s) = M s ) ~ e~ hs /s, and then taking f 3 (t) = j T < 5 ’ 

l J 3 V') + I? t >0. 

This procedure not only removes the singularity but generally hastens convergence, 
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and the error remains relatively lower in the neighborhood of t = 5, due to the 
nonexistence of the first derivative. 


In (iv) the results obtained with ET are compared to those of Dubner and Abate 
discussed in §7.4.1. 


Example 7.4.4. Haines (1982) uses Crump’s formula (7.4.13) and considers 
the three test cases: 


(i) fi( s ) = e with a = 0.1, for which fi{t) = 


a e~ a ^ 4t \ 
2 \Art 3 


_ g Oj'^s g & /(4t) 

(ii) / 2 (s) = —with a = 1.0,0.1,0.05, for which f 2 (t) = -=—; and 

v 5 V^t 

_ \/~s~~\~~b e 

(iii) fs(s) = -, with a = 1.0,0.5,0.1 and b = 0.5,0.1, for which 


fs(t) = 


e -a 2 /(At)+bt) y/jj 

\pKt 2 


0 aVb 


erfc I 


2 Vt 


v bt)-\~c 


—a\/b 


erfc 


(— 

V2 Vi 


— ybt 


The e-algorithm is used to accelerate convergence. For e-algorithm and related 
codes, see the file algorithms.pdf on the CD-R. 


The results for some selected values of a and b are shown in Tables 7.4.4(i)- 
7.4.4(iii); other tables can be found in Haines (1982). The results in these tables are 
obtained for very small values of t\ they exhibit instability for very small values of 
t\ for example, in Table 7.4.4(i) the instability for accuracy in the fifth decimal digit 
starts at t = 0 . 2 (—3). 


Table 7.4.4(i). Example 7.4.4(i) with a = 1. 


t 

m) 

hit) 

0.3(—3) 

0.13049460(+1) 

0.13049464(+1) 

0 . 2 (—3) 

0.37167999(—1) 

0.37168004(—1) 

0 . 1 (—3) 

0.40281254(—6) 

0.39177183(—6) 

0.9(—4) 

0.39198591 (-7) 

0.28529613(—7) 

0 . 8 (—4) 

0.12263991(—7) 

0.10569580(—7) 

0.7(—4) 

—0.27260081(—8) 

—0.14867262(—10) 

0 . 6 (—4) 

0.10158857(—7) 

0.48704037(—13) 

0.5(—4) 

0.30174193(—7) 

0.15389204(—14) 

0.4(—4) 

0.17049456(—8) 

0.80149376(—22) 

0.3(—4) 

0.13077603(—10) 

0.11053671(—30) 

0 . 2 (—4) 

0.78363141(—15) 

0.16294452(—48) 

0 -l(—4) 

0.69315321(—23) 

0.23810843(—102) 
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Table 7.4.4(ii). Example 7.4.4(H) with a = 0.1. 


t mt) hit) 


0.5(+l) 

0.3(+l) 

o.i(+i) 

0.9(+0) 
0.7(+0) 
0.5(+0) 
0.3(+0) 
0 . 1 (+ 0 ) 
0.9(—1) 
0.7(-l) 
0.5(-l) 
0-3(—1) 
O.l(-l) 
0.9(—2) 
0.7(—2) 
0.5(—2) 
0.3(—2) 
0 . 1 (- 2 ) 
0.9(—3) 
0.7(—3) 
0.5(—3) 
0.3(—3) 
0-l(—3) 
0.9(—4) 


0.25218725(+0) 
0.32546384(+0) 
0.56273116(+0) 
0.59305866(+0) 
0.67193183(+0) 
0.79390550(+0) 
0.10215169(+1) 
0.17400748(+1) 
0.18291120(+1) 
0.20576227(+l) 
0.24000792(+l) 
0.29969084(+l) 
0.43939158(+1) 
0.45047091(+1) 
0.47181489(+1) 
0.48394184(+1) 
0.44766462(+l) 
0.14644984(+1) 
0.11693117(+1) 
0.59954654(+0) 
0.17996755(+0) 
0.78296866(—2) 
0.31563134(—7) 
0.19072069(—7) 


0.25206117(+0) 
0.32519271(+0) 
0.56137591(+0) 
0.59141352(+0) 
0.66953629(+0) 
0.78994532(+0) 
0.10150395(+1) 
0.16971121(+1) 
0.17790023(+1) 
0.19854328(+1) 
0.22830257(+l) 
0.27572085(+l) 
0.34219842(+1) 
0.34121592(+1) 
0.33011547(+1) 
0.29352545(+l) 
0.19455414(+1) 
0.12021339(+0) 
0.72708760(—1) 
0.16856709(—1) 
0.11455069(—2) 
0.19828159(—5) 
0.10831810(—19) 
0.44343767(—22) 


Table 7.4.4(iii). Example 7.4.4(iii) with a = 0.5 and b = 0.1. 


t 


h{t) 

0.6(—2) 

0.21789604(—3) 

0.21787624(—3) 

0.5(—2) 

0.29731833(—4) 

0.29720595(—4) 

0.4(—2) 

0.15438832(—5) 

0.14688921(—5) 

0.3(—2) 

0.34331774(—7) 

0.92244034(—8) 

0.2(—2) 

0.19941938(—8) 

0.33816683(—12) 

0.1(-2) 

0.10700834(—11) 

0.12822632(—25) 


continued next page 
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Table 7.4.4(iii). Example 7.4.4(iii) with a = 0.5 and b = 0.1, Continued. 


t 

m) 

h{t) 

0.9(—3) 

0.19269665(—12) 

0.13027455(—28) 

0 . 8 (—3) 

0.22469598(—13) 

0.23474122(—32) 

0.7(—3) 

0.14041946(—14) 

0.35690526(—37) 

0 . 6 (—3) 

0.35624924(—16) 

0.21787624(—3) 

0.9(—3) 

0.21789604(—3) 

0.13283579(—43) 


7.4.3. Durbin’s Improvement. Durbin (1974) improved upon the above 
method by constructing an infinite set of functions k n ( t ) with period 2 T for n = 
0 , 1 , 2 ,... , as follows: 


( h(t) if nT <t<(n + 1 )T, 

\ —h(2nT — t) if (n — 1 )T <t< nT. 


(7.4.16) 


For example, k n (t) in the intervals (—T, 0), (0, T), and (T, 2 T) for even and odd 
values of n, respectively, is given by 


k n (t) 


k n (t) 


—h(nT — t) if — T < t < 0, 

< h(nT -\-t) if 0 <t<T, 

—h(nT — t) if T < t < 2T, 
h((n + 1)T + t) if — T < t < 0, 

< -h((n-\-l)T — t) if0 <t<T, 
h((n — T)T + t) if T <t < 2 T, 


for n = 0, 2,4,... ; 

(7.4.17) 


for n = 1, 3, 5,... . 

(7.4.18) 


The Fourier series representation for each k n (t) is 


oo 

kn(t) = ^2 B n ,k sin u> k t, 

k=0 


(7.4.19) 


where 

An + l)T 

B ntk = / e~ ct f(t) sin u k tdt. (7.4.20) 

JnT 

Summing B n k in (7.4.20) over n and using the Fourier integrals for 5ft{/(s)} and 
9{/(s)}, we get 

00 c\ p OO c\ 

y2 B n,k = 7f e~ ct f(t)sinuj k tdt = ~-^{f(c + iuj k )}, (7.4.21) 

n =0 1 Jo 1 
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which, after multiplying both sides of (7.4.21) by e ct sin uj^t and using (7.4.19), gives 

°°^ °°^ 2e ct - 

yU ct fc„(i) = sin u) k t = —— [7s{/(c + iu> k )} sinu> fe i], (7.4.22) 

n =0 n =0 

Note that (7.4.22) is similar to (7.4.4). Again, we let h(t ) = e~ ct f(t) and use the 
last two representations in (7.4.17) and (7.4.18). This yields 

oo oo 

E e ° tk "(*) = /(*) + E e ~ 2CkT 7( 2fcT + *) - e 2ct f(2kT - t )]. 

n =0 k =1 


Thus, f(t) can be represented as 


f{t) + Error(E) = [9{/(c + iw fe )} sinw fe t]. 

Adding (7.4.4) and (7.4.23) and dividing by 2, we get 
f(t) + \{E 1+ E 2 ) 


\ U/( c )} + E {^{/ ( c + iLJ k) } COS U k t 


k =1 


- 9{/(c+ iu k )} sin Ukt \} 


(7.4.23) 


(7.4.24) 


which can be compared with Crump’s formula (7.4.13). The error E 2 in formula 
(7.4.24) is the average of the errors from (7.4.5) and (7.4.23), i.e., 

00 

E 2 = \ (Eh + £ 2 ) = E e~ 2ckT f(2kT + 1). (7.4.25) 

k =1 

If \f(t)\ < C , then 

00 C cT 

ft < £ = JStTT- < 7 - 4 - 26 > 

fc=l 

Thus, the error estimate in (7.4.26) is superior since it does not depend on t, decreases 
as aT increases, and allows the representation (7.4.24) of f(t) to be used for the 
interval (0, T). If \f(t)\ < Ct m , then from (7.4.25) we find that 

oo oo 

\E 2 \ < C e~ 2ckT (t + 2kT) m < C (2T) m e~ 2ckT (k + l) m . (7.4.27) 

k =1 k =1 

A comparison of the series on the right side of formula (7.4.27) to the integral 
f^° e~ 2cxT (x + 1 ) m dx shows that the error is bounded by 

m+l 

\E 2 \<A{2Tre-* T ^ 
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where A and a k are constants (Durbin 1974) . 

Durbin’s method is implemented as follows. First, take the average of formulas 
(7.4.6) and (7.4.23): 

pd |- _ OO _ 

f(t) ~ {/(c)} + E 3? {/ (c + iw fe )} cos w k t 

1 1 fc=i (7.4.28) 

- {^{/(c+*w fe )}sinw fe t]} , 

and replace T by T/2 in formula (7.4.6) so that its applicability is extended to the 
interval (0, 2T). But Kythe and Puri (2002) suggest to replace T by 2T, and not by 
T/2, so as to cover the interval (0,2T). This leads to more accurate results. In fact, 
replacing T by T/2 in (7.4.6) and (7.4.28), we get Durbin’s formulas (marked (41) 
and (42) in Durbin 1974): 

ApCt r _ OO _ -| 

f{t) ~ - 7 f- 3 ^{/(c)}+ E 3? {/(c + ioJk)} cos2u) k t 

1 1 k =1 J 

9 P ct 

[i»{/(c)} 

OO 

+ ^^{/(c + L^)} cos2u; k t - {^{f(c + iu; k )}sm2u; k t}}]. 
k =1 

But if we replace T by 2T in (7.4.6) and (7.4.28), we get 

pd r _ OO _ 1 

f(t) ~ \ 3?{/(c)} + E * {/ ( c + i^k)} cosw fc t/2 (7.4.29) 

i L k =1 J 

OO 

+ T ^ { 7 (c + *Wfc)} coswfct /2 - {9{/(c + iwfc)} sino;fct/ 2 ]}], 
fe=i (7.4.30) 

Both Dubner and Abate (1968) and Durbin (1974) suggest the use of the fast 
Laplace inverse transform (FLIT) for more efficient computation. Durbin’s procedure 
for the FLIT is as follows: For f(t) to be evaluated at equidistant points, set t 3 = j A t, 
where At = jT/N for j = 0, 1 , 2 ,... , N — 1 , define 

s k — c + 2iio k , f(s k )=?H{f(s k )}-\-i^{f(s k )}. (7.4.31) 

This gives Durbin’s formulas ((42) in Durbin 1974): 

e 2cjAt r 

f(t) = E 2 + E t + E N = |j K{/(c)} 

N 

+ T ^ {/(-Sfc)} cosu) k tj/2 - {9{/(sfc)} sin 2 ^]} , 
fc=i 
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where Eq (7.4.31) is derived by replacing T by T/2. However, by the Kythe-Puri 
modification, the correct replacement is 2T in place of T, which yields 

/ W = E 2 -\- E t -\- E r 

= OT , |5ft{/(c)}+ 3?{/( s fc)} cos 2uktj - {Q{f(s k )}sm2u> k tj]} , 

Z1 L ju_i 

(7.4.32) 

where E t and E r represent the truncation and roundoff errors, respectively. 

Example 7.4.5. Consider Example 7.4.1, where /(s) = 1/ (s 2 -b s -b l). The 
values of f(t) are presented in Table 7.4.5, which can be compared with those in 
Table 7.4.1. For computational details see weeks .nb on the CD-R. ■ 


Table 7.4.5. 


t 

Exact 

Durbin 

t 

Exact 

Durbin 

0.0 

0.000000 

0.002026 

5.5 

0.039320 

-0.073720 

0.5 

0.353907 

0.377345 

6.0 

0.013679 

-0.050895 

1.0 

0.403341 

0.533507 

6.5 

-0.008259 

-0.027236 

1.5 

0.245024 

0.525425 

7.0 

-0.017710 

-0.007647 

2.0 

0.034610 

0.419279 

7.5 

-0.015174 

0.005718 

2.5 

-0.109170 

0.274111 

8.0 

-0.006552 

0.012711 

3.0 

-0.145411 

0.133242 

8.5 

0.001736 

0.014516 

3.5 

-0.099507 

0.022130 

9.0 

0.005953 

0.012780 

4.0 

-0.025210 

-0.049531 

9.5 

0.005731 

0.009308 

4.5 

0.031623 

-0.083450 

10.0 

0.002921 

0.005380 

5.0 

0.051331 

-0.087944 





Example 7.4.6. (Durbin 1974) Consider f(s) = s(,s 2 -bl) _2 for which f(t) = 
O.btsmt. The results in Table 7.4.6 are computed for N = 2000 as well as for 
N = 100, 500, and 600. The error appears at the fourth decimal digit for N = 100 
and at the sixth decimal digit for both N = 500 and 600. In this table f\ (column 2) 
corresponds to Dubner and Abate’s method (replacing T by T/2); (KP) (column 
3) to Dubner and Abate’s method (replacing T by 2T); / 3 (column 4) to Durbin’s 
(replacing T by T/2); / 4 (KP) (column 5) to Durbin’s (replacing T by 2T); column 
6 to FLIT1 of Durbin (1974); column 7 to FLIT2 with T replaced by 2T; and column 
8 to the exact solution f(t). All these results are obtained using Mathematica with 
T = 20, aT = 5, and N = 2000, where N is determined from the error estimates. 
It is obvious that the results in all cases where T is replaced by 2T are more accurate 
than those where T is replaced by T/2. Some of our results using Durbin’s formula 
(42), in particular for t = 1, are different from those obtained by Durbin himself. For 
computational details, see durbin. nb on the CD-R. ■ 
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Table 7.4.6. 


t 

h 

h (KP) 

h 

U (KP) 

FLIT1 

FLIT2 

Exact 

0 

0.1243 

—1.2(—7) 

0.0621 

—6.1(—8) 

0.0621 

—6.1(—8) 

0.0000 

1 

0.4970 

0.4207 

0.4797 

0.4207 

0.4797 

0.4207 

0.4207 

2 

0.7846 

0.9092 

0.9077 

0.9092 

0.9077 

0.9092 

0.9092 

3 

-0.1038 

0.2116 

0.1452 

0.2116 

0.1452 

0.2116 

0.2116 

4 

-1.7074 

-1.5136 

-1.5868 

-1.5136 

-1.5868 

-1.5136 

-1.5136 

5 

-2.0114 

-2.3973 

-2.4075 

-2.3973 

-2.4075 

-2.3973 

-2.3973 

6 

0.1760 

-0.8382 

-0.7705 

-0.8382 

-0.7705 

-0.8382 

-0.8382 

7 

3.0208 

2.2994 

2.3865 

2.2994 

2.3865 

2.2994 

2.2994 

8 

2.8200 

3.9574 

3.9821 

3.9574 

3.9821 

3.9574 

3.9574 

9 

-1.5723 

1.8545 

1.7886 

1.8545 

1.7886 

1.8545 

1.8545 

10 

-5.6405 

-2.7201 

-2.8202 

-2.7201 

-2.8202 

-2.7201 

-2.7201 

11 

-2.5924 

-5.4999 

-5.5413 

-5.4999 

-5.5413 

-5.4999 

-5.4999 

12 

7.6657 

-3.2194 

-3.1588 

-3.2194 

-3.1588 

-3.2194 

-3.2194 

13 

13.5386 

2.7310 

2.8427 

2.7310 

2.8427 

2.7310 

2.7310 

14 

1.3008 

6.9342 

6.9941 

6.9342 

6.9941 

6.9342 

6.9342 

15 

-24.5049 

4.8772 

4.8254 

4.8771 

4.8254 

4.8771 

4.8771 

16 

-34.2959 

-2.3030 

-2.4241 

-2.3032 

-2.4241 

-2.3032 

-2.3032 

17 

-3.4398 

-8.1718 

-8.2515 

-8.1718 

-8.2515 

-8.1718 

-8.1718 

18 

42.8424 

-6.7592 

-6.7196 

-6.7588 

-6.7196 

-6.7588 

-6.7588 

19 

44.7389 

1.4230 

1.5513 

1.4238 

1.5513 

1.4238 

1.4238 


e -iOs 

Example 7.4.7. (Durbin 1974) Consider f(s) = - for which f(t) = 

U(t — 10), where XJ(x) is the unit step function. Table 7.4.7 presents the computed 
data for the same values of c, T, and N as in Example 7.4.6; the last five columns (2- 
6) represent the results obtained from formulas corresponding to those in Table 7.4.6, 
and the last column corresponds to the exact values of f(t). Table 7.4.7 confirms the 
remarks made for Table 7.4.6. We have also found that Dubner and Abate’s formula 
(15) does not give the average value at the point of discontinuity when T is replaced 
by T/2, but it does yield the average value at the point of discontinuity when T is 
replaced by 2T. For computational details, see durbin. nb on the CD-R. ■ 


Example 7.4.8. (Durbin 1974) Consider f(s) = 


s(l + e~ 2s ) 


for which 


f{t) = 2 J2T=o(—U( t — 2k), where U(x) is the unit step function. Table 7.4.8 
gives the values obtained from formula (7.4.29) in column 2; values obtained by 
Durbin (1974) using the FLIT in column 3; and the exact values in the last column. 
For computational details, see durbin. nb on the CD-R. We note that the accuracy 
of the two methods is about the same. ■ 

Example 7.4.9. Consider /(s) = /w ——^ for which the exact solution 


8(1 
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is the square wave with discontinuities at t = rm, where n is an integer, i.e., f(t) = 

oo 

E(-u U(t — nir) , where U(t — a) is the unit step function defined by U(t — a) = 0 

n =0 

for t < a, U(t — a) = 0.5 for t = a, and U(t — a) = 1 for t > a (see Abramowitz 
and Stegun 1968). 

Table 7.4.7. 


t 

fi 

/ 2 (KP) 

h 

/ 4 (KP) 

Exact 

0 

0.01356 

0.00003 

0.00678 

0.00001 

0.0 

1 

0.01796 

0.00004 

0.00678 

0.00002 

0.0 

2 

0.02522 

0.00005 

0.00678 

0.00003 

0.0 

3 

0.03718 

0.00007 

0.00679 

0.00005 

0.0 

4 

0.05690 

0.00010 

0.00679 

0.00007 

0.0 

5 

0.08942 

0.00014 

0.00680 

0.00011 

0.0 

6 

0.14303 

0.00022 

0.00682 

0.00018 

0.0 

7 

0.23142 

0.00036 

0.00685 

0.00031 

0.0 

8 

0.37715 

0.00067 

0.00693 

0.00061 

0.0 

9 

0.61742 

0.00164 

0.00717 

0.00157 

0.0 

10 

1.01331 

0.49957 

0.50665 

0.49949 

0.5 

11 

1.01797 

0.99749 

1.00614 

0.99740 

1.0 

12 

1.02522 

0.99844 

1.00638 

0.99833 

1.0 

13 

1.03719 

0.99871 

1.00645 

0.99857 

1.0 

14 

1.05691 

0.99879 

1.00649 

0.99863 

1.0 

15 

1.08943 

0.99879 

1.00651 

0.99860 

1.0 

16 

1.14304 

0.99874 

1.00652 

0.99852 

1.0 

17 

1.23143 

0.99864 

1.00655 

0.99838 

1.0 

18 

1.37716 

0.99850 

1.00659 

0.99819 

1.0 

19 

1.61743 

0.99833 

1.00666 

0.99795 

1.0 


Duffy (1993) has noted that many popular methods fail to provide a satisfactory 
result for this function because f(s) has infinitely many poles along the imaginary 
axis at s = —(2 n + 1)tt i, where n is an integer. We apply the modified Durbin’s 
method (1974), and the results are presented in Table 7.4.9. For computational details, 
see ex7.4.8. nb on the CD-R. ■ 

Albrecht and Honig (1977) use a min-max method and approximate f(t) by 


fN{t) 


T 


1 5R {/(c)} + E(-l) fc ^ {/(c + } 


which is almost the same as in Durbin’s formulation. 
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Table 7.4.8. 


t 

(7.4.29) 

FLIT 

Exact 

0 

0.99802 

1.006615 

1.0 

1 

1.99212 

2.012790 

2.0 

2 

0.99863 

1.006321 

1.0 

3 

0.00503 

0.000511 

0.0 

4 

0.99863 

1.007322 

1.0 

5 

1.99217 

2.012833 

2.0 

6 

0.99840 

1.005719 

1.0 

7 

0.00458 

0.000549 

0.0 

8 

0.99798 

1.008010 

1.0 

9 

1.99133 

2.012913 

2.0 

10 

0.99734 

1.005268 

1.0 

11 

0.00327 

0.000820 

0.0 

12 

0.99639 

1.009086 

1.0 

13 

1.98940 

2.013551 

2.0 

14 

0.99501 

1.005602 

1.0 

15 

0.00048 

0.002814 

0.0 

16 

0.99303 

1.017248 

1.0 

17 

1.98538 

2.019597 

2.0 

18 

0.99021 

1.017248 

1.0 

19 

-0.00525 

0.039362 

0.0 


Table 7.4.9. 


t 

(7.4.29) 

Exact 

Error 

0.0 

0.506631 

0.5 

0.006631 

1.0 

1.00604 

1.0 

0.00604 

7r/2 

1.0062 

1.0 

0.0062 

2.0 

0.999673 

1.0 

0.000327 

3.0 

0.997796 

1.0 

0.002204 

7T 

0.500124 

0.5 

0.000124 

4.0 

0.000155 

0.0 

0.000155 

5.0 

-0.0000343 

0.0 

0.0000343 

27T 

0.507113 

0.5 

0.007113 


7.4.4. Discretization Errors. All the above methods based on the Fourier 
series expansion approximate f(t) by a truncated cosine, sine and complex Fourier 
series. We will denote expressions for f(t) in these three cases by f 2 (t) and 
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fs(t), respectively, so that for t > 0 

2e ct 

fi(t) =- / ^{/( 5 )i cos out duo, 

k Jo 

2e ct f°° 

/ 2 O =-/ 3{/(s)} sin Lotdh), 

^ JO 
pCt poo 

h(t) = — »{/(«) e*"*} do;, 

^ Jo 

where /1 and are contained in (7.4.1). After discretization of these three repre¬ 
sentations and using the trapezoidal rule with step size h/ir/T.t E [0, T], we obtain 
fi(t) = fi(t) + for i = 1,2, 3, where fi(t) is the right side of (7.4.6) or the real 
part in (7.4.7), fait) is the imaginary part with the minus sign of (7.4.7), and 

h(t) = - 7 f \ /(c) + E / (c + ikn/T) e ik7rt / T \, 

1 K k =1 J 

with the discretization errors e^i = 1,2,3 which are defined by (de Hoog et al. 1982, 
D’Alessio et al. 1994) 


e x = ]T e~ 2ckT j/(2fcT + t) + e 2ct f(2kT - £)}, 

k =1 
00 

e 2 = e ~ 2ckT |/(2fcT + t)~ e 2ct f(2kT - i)|, 

k =1 


ei = J2 e ~ ckT f( 2kT + t), 

k =1 


The methods of Dunbar and Abate (1968), Durbin (1974), Crump (1976), Honig and 
Hirdes (1984), and Piessens and Huysmans (1984) are based on the above analysis. 

Let s = c + iy, w = y + i£, and 7 = c — co. Murli and Patruno (1978) have 
proved that the functions 


u(j,w) 


+ -iw) ' 


f(p( + iw) - 
2 i 


are analytic in the strip |£| < a in the complex w -plane, and that u(c, y) = u(c, —y) 
and v(c,y) = —v(c,—y). Define a class Sd of functions g for which \g(s)\ = 
g(c + iy)\ < A/\c\P for |c| > 6 and \y\ < d for all A > 0 and j3 > 1 . Let 
f(s) = u(c,y) + iv(c,y) be the Laplace transform of a real function f(t). If 
u( 7 , 2 /) G and t E (0, 7 t/ 2 ), then 


2h v 00 / 

/(/) ~ — e 7t ±w( 7 , 0 ) + £ wU. 
^ L fc=l V 


27r£u 
crt 7 


27rfci 


cos ■ 


(7.4.33a) 
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with the error bound 


, , 4 f°° 

|ei(i)| < -iMi(rf), Mi(d) = / \u(j, y) + i d\ dy, 

ft Jo 


(7.4.33b) 


g— d(a— 1 — a)t 

where A = - _ , and d = j/a, a > 1, and a = 27r/(ht) > 2. Similarly, 

^ CLCTl 

using v(c,y) instead of tz(c, ?/) we have the approximation 


fit) 


2h 


7r 


,7^ 


OO / 

|“(7,0) + E u (7, 

L fc = l V 


27tA:\ . 2irk 

- sin - 


at J 


a J 


(7.4.34a) 


with the error bound 


, , 4 r°° 

|e 2 (i)| < - AM 2 (d), M 2 {d) = \v(j,y)+id\dy, 

ft Jo 


(7.3.34b) 


Note that the formulas (7.4.33) and (7.4.34) represent the approximations of the 
inverse Laplace transform, which use a series obtained by formally replacing the 
functions 3ft{/(s)} and 7s{/(s)} by their Whittaker cardinal series, and the errors 
are defined in terms of f(s). Also, the integrand in M\{d) is Sft{/(s)}, and that in 
M 2 (d) is $s{f(s)}. Thus, for the functions i = 1, 2, 3 we have for t > 0 we 
get (D’Alessio et al. 1994) 


hit) 

hit) 

hit) 


e it f°° 

— / uOl,y) costydy + ei{t), 

e 7t 

-/ «(7>2/) smtydy + e 2 {t), 

ft J — OO 

r°° 

7 ^ J ${fij + iy)e ltv }dy + e 3 (t), 


(7.4.35) 


where the corresponding truncation errors are 
Mi) I < — AM\(d), 

7r 

|e 2 (i)| < — AM 2 (d), 

7T 

\e e (t)\ <-A [M^d) + M 2 (d )]. (7.4.36) 

7T 

The error estimates (7.4.36) hold for any inversion formula derived from the Fourier 
series method, with the only restriction that /(s) be in the class Sd- The parameter 
7 , defined by 7 = c — Co is another value of c (> co), and the parameter a > 1 
is arbitrary; Murli and Patruno (1978) take a = 1.1. The value of a is related to 
the discretization step size h by a = 2n/(ht), which by taking h = n/T becomes 
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c 7 = 2T/t and is easier to use because of its dependence on T which is known in 
advance. 

7.4.5. Use of FFT Algorithm. Cooley et al. (1970) and Wing (1967) 
introduced the FFT algorithm to Weeks’ method (§7.2.5(c)) to compute (7.2.21) for 
a n in terms of the values of the left side of (7.2.21). There are two procedures for using 
the FFT technique to compute an inverse Fourier transform in terms of an expansion 
in terms of the Laguerre polynomials L n (pc). 

Procedure 1. It starts with Weeks’ method and goes through the following 
steps. 

(a) Select a scale factor T, a constant c, and an N, as defined in (7.2.23). 

(b) Let A 9 = 27 r/iV, and 9k = k A 0 for k = 0,1,... , N — 1. 

7T 9k 

(c) Compute rjk = ~ cot —, k = 0,1,... , N — 1, 

(d) Compute the sequence {Hk }^_ 0 = (irjk + T/2) / (c + irjk)- 

(e) Go to the FFT algorithm (§7.6.4) to compute 

IV-1 

H k =J2 h J e 2i * jk/N for k = 0,1,... , N - 1. 
i =o 

(f) For each value at which the inverse Laplace transform f(t) is desired, evaluate the 
series 

IV-l 

f(t) » e (c - T l^ £ h 3 U (I), (7-4.37) 

3=0 

which is the truncated series (7.2.19). 

Procedure 2. This is a direct application of Theorem 7.6.1. Consider g(s) = 

nOO 

/ g(t) e~ st dt. Let s = c + 777 , where c and 77 are real. Then defining 77 = 

Jo 

we get 

nOO 

g(s + 2iiujo) = / g(t) e - ct - 2l7rujt (7.4.38) 

Jo 

This Fourier transform pair contains the functions which are 

F(u) =g(c+2iiruj), f(t) = U(t)g(t)e~ ct , (7.4.39) 

where U(t) is the unit step function. There is one new positive parameter c in formula 
(7.4.38), which may be chosen by the user to optimize computation. There is a finite 
range of values of c that permit numerical accuracy. Substituting (7.4.39) into (7.4.38) 
we get F(u) as the Fourier transform defined by F(u) = J 0 °° f(t) e~ 2l7rujt dt , with 
real and imaginary parts 

nOO nOO 

3ft{F(o;)} = / f(t) cos27 xuotdt, 77{F(a;)} = / f(t) sin27r uotdt. 

Jo Jo 

(7.4.40) 
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We use Procedures 6 and 7 (§7.6.3) to compute the cosine and sine series for real 
data. The integrals in (7.4.40) can be written as complex integral transforms; thus, 

/ OO POO 

fe(t) e~ 2i7rult dt, 3{FH}= / fo(t) e~ 2i7rult dt, 

-OO J — OO 


where f e (t) = \ [f(t) + f(-t)} and f Q (t) = \ [f(t) - f(-t )] are the even and odd 
parts of /(£), respectively. 

Example 7.4.10. (Cooley et al. 1970) Consider the function f(s ) = 1/s, 

c 2 ttu 

« = c + i = 2™. Then /(.) = ^ + - i c2 + (2m)2 - Tl>u s . 


»W")1 = 


( 2iujj) : 


r, *{F(u)} = -i 


2lTLO 


c 2 + (2ttlo) 2 


OO 

Since the periodized F(u) is defined as F p (uo) = F(uo + k/At), the sum 

k= — oo 


OO oo 

»{ W }= Y, »{F(- + */At)}= E ^ + (2^(L t /A^ 

\ / \ / / 


converges and is a real symmetric function of a;. Now, applying Theorem 7.6.1, the 
IDFT of the sequence hj = 3ft {F p (j Auo )} is the sequence Hj~ = T f ep (kAt), where 

oo 

fep(t) = E fe{t + kT) is the periodized f e (t). 

k= — oo 

The total error, due to aliasing and round-off, is 


E = E\ + E 2 


2r 


2d r/(T_r) r (T_2r)/(T_r) = < 


2 a 1 / 3 r 2 / 3 


at r = 0, 
at r = T/4, 


[2d atr = T/2, 


where a = max(T — t) and r = maxr(t), where the round-off error is given by 
In (f/f) 

E r = e ct r(t ), and c = —/--, 0 < t < r. Thus, at T/2 the error is as large as 

f(t) itself for all t. At smaller values of t, the error contains two factors: / arising 
from aliasing, and f arising from round-off. Therefore, the error criterion should be 
applied to a smaller range of t. The reasonable choice is to optimize the solution in 

4 / 

the range 0 < t < T/4, where we take c for r = T/4 as c = — In — to obtain an 
error less than E = 2 J 1 / 3 ^ 2 / 3 . 

For/(s) = 1 /s,f(t) = U(t), and the IDFT gives the values of =T f e (tk) = 

T 2N 2 

— f (tk). The error in f(t) is bounded by f < 10 -6 = — 10 -6 , with T = 8, 
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N = 32, which gives At = 4 and A uo = 1/8. Taking / = 1, we get r = 8 x 10 6 , 
and the resulting error estimate is 

E = 2 (8 x 1CT 6 ) 2/3 = 8 x 1CT 4 , 

4 10 6 15.7 

with c = — In - = - « 2 for T = 8. Thus, for this case we find computed 

3 T 8 T 

values of f(t) which are in the range 0<t<T/4 = 2 with error of at most 8 in 
the fourth digit. The limitation on the range seems to be the only drawback to this 
method. ■ 

Example 7.4.11. (Cooley at al. 1970) The effect of the choice of c is displayed 
by carrying out the computations for the following transform pairs: 

(i ) J(s) = e -A f(t) = U(t- 4); 

(ii) f(s) = 1 <—> f(t) = Jo(t); 

Vs 2 + 1 

(iii) f(s) = ^ < — y /(0 = 

All three cases are computed with T = N = 32, which gives the values At = 1, 

2 

1/A = 1, Au = 1/32, so f = — x 10 -6 = 2 x 10 -6 , and / = 1; thus c = 
jL y i/ 3 f 2 /3 — 2.6 x 10 -4 . For example, for the case (ii) Cooley et al. (1970) have 

O-Z. 

found the errors using T = N = 32 and c = 0.3,0.5,0.7, which are compared with 
those obtained by Durbin’s method for c = 0.3. These results are presented in Table 
7.4.11, which show a far better performance of Cooley et al. ■ 

Table 7.4.11. Errors in Example 7.4.11(ii). 


Cooley et al. 

Durbin 

t 

m 

c = 0.3 

c = 0.5 

c = 0.3 

c = 0.5 

0 

1.00000000 

15.1(—4) 

25.4(—4) 

5002.3(—4) 5004.0(—4) 

1 

0.76519789 

0.0(—4) 

0-l(—4) 

10.9(—4) 

13.3(—4) 

2 

0.22389078 

0.2(—4) 

0-l(—4) 

7.3(—4) 

10.8(—4) 

3 

-0.26005195 

0.7(—4) 

0.1(—4) 

6-3(—4) 

11.7(—4) 

4 

-0.39714981 

0.5(—4) 

0-l(—4) 

6.4(—4) 

14.1(—4) 

5 

-0.17759677 

1.1(—4) 

0.2(—4) 

6.6(—4) 

18.1(—4) 

6 

0.15064526 

4.0(—4) 

0.3(—4) 

7-l(—4) 

23.9(—4) 

7 

0.30007927 

4.3(—4) 

0.5(—4) 

7.9(—4) 

32.0(—4) 

8 

0.17165081 

4.8(—4) 

1.3(—4) 

8.7(—4) 

43.3(—4) 
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7.4.6. Improvement of the FFT Algorithm. (Hwang et al. 1991) 
The method developed by Dunbar and Abate (1968), which uses the finite cosine 
transform, has the main drawback that the series (7.4.6) usually converges slowly 
and this formula is restricted to the interval (0, T). Crump’s method (1970) uses the 
complex Fourier series and develops the approximation (7.4.13) which we rewrite as 

ct ^ 

/(*) = E /> + fc/r)e-“ /T ), 0 < t < 2T. (7.4.41) 

k =—oo 


Formula (7.4.41) is obtained after applying the trapezoidal rule with lo^ = kir/T 
and Alu = i r/T. If we set t = kAt and NAT = 2 T in (7.4.41), we obtain the 
approximation 


ckAt N ~ 1 

f(kAt) « — E A i e 2 ™ jk/N , k = 0,l,...,N-l, (7.4.42a) 

3 = 0 

where 

oo 

Aj= E f{c+m(j + nN)/T), (7.4.42b) 

n =—oo 

TV is taken as radix 2, and the values of f(kAt) in (7.4.42) are computed by the 
FFT algorithm (§7.6.4). But this use of the FFT has the disadvantage of creating a 
compromise between the numerical accuracy and the computation effort. The interval 
of integration used in (7.4.41) is restricted to A u = tt/T , and a larger T is chosen for 
desired accuracy in cases where the function f(c + iu) is oscillatory. A larger value 
of T demands a larger value of TV, which results in more computation time. Another 
drawback in formula (7.4.42) is that it produces an aliasing error (see Examples 7.4.10 
and 7.4.11 above). 

Hwang et al. (1991) start with 


nt) = 


ct r OO 

— / f(ci ll>) e luJt dt 
7 -oo ^ 

1 r°° r 

— / 3ft {f(c + To;)} costbV — ^ {/(c + To;)} sino;T 
^ 7o L 


(7.4.43a) 
duo , 

(7.4.43b) 


and apply trapezoidal rule with cj = jii/(rriT) and Acj = 7 r /(mT) to the integral 
(7.4.43a); then we obtain the complex Fourier series 

ct 00 

/( * )= 2^T 5T /(c + 2WW)^ t/(mT) 

j=-oo 
ct M 

= Nf E /(c + 2j7r/(mT)) e^( mT ) + e ct £?(t), 

j=~M (7.4.44) 
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where E(t) is the truncation error. We choose a positive integer M such that e ct E(t) 
is negligibly small as compared to \f(t)\. Let t = A:AT, AT = 2 T/N, M = 

TflTlN 771 — 1 

—-- 1 --—, and taking N as radix 2, the FFT-based approximation, as developed 

by Hwang and Lu (1991), is 


/(fcAT) = 


„ckAt 


2 mT 


W N ! 2 


kn 


m 2 N— 1 

E { E 


= (-l) 


kn 


r= — mi j =0 

~ckAt iV-1 


(7.4.45a) 


2 mT 




r= — m i 


j=0 


(7.4.45b) 


where the asterisk denotes complex conjugate, and 


777/1 = 


77l 2 = 


[777/ — 1 1 


where [ ] denotes the integral part, 


777/1 for 777/ odd, 

777/1 + 1 for 777/ even, 


frU) = EU c + i7r (.7 +r/m+ (2p-n) N /2) /T), j = 0,1,... , AT — 1 , 
p=o (7.4.46) 


m 


n for j = 0 and r ^ m/2, 
77 — 1 otherwise. 


Formula (7.4.45b), which is an improvement over FFT algorithm developed in §7.4.5 
by Cooley et al. (1970), uses five parameters: c, T, N , m and 77, where the values 
of f(kAT) for k = 0,1,... , N — 1, can be obtained by m sets of TV-point FFT 
algorithm. With appropriate choices of these five parameters, the function f r (j ) can 
be computed from the given function /( s ) by using (7.4.46). Let 


N-l 

fr(k)=J2frU)W~ jk , k = 0,1,...,N-l, (7.4.47) 

3=0 

and let the TV-point sequences 

{/;(0),/;(!),..• , ft (N-l)} and {/ r (0), / P (l),... , f r (N - 1)} 

be denoted by an d { fr (k)} N , respectively. Then the sequences 

become the output of the FFT subroutine with the sequence {fr(k)} N as the input 
data, i.e., 

{/+)} — 
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The indicial function f(t) at t = kAT is approximated by 

ckAt m2 

f(kAT) = (-l) fc «L-^ 52 fr ( k ) k = 0,l,...,N-l. (7.4.48) 

r= — m\ 

But formula (7.4.45b) need not actually perform m sets of TV-point FFT computations 
because of the following relationships between f r (j) and /_ r (j): 


f*(c + iu>) = f*(c — iw), 


fo(j) 

fr(j) 


real for j = 0, IV/2, 

/ 0 *(7V-j) for 7 = 1,2,... , 7V/2 — 1, ’ 
f- r (N — j) forr = 1,2,... ,mi, 
r(N-j-l) for j = 0,1,... IV/2 — 1; r 


(7.4.49) 


m/2 and m even. 


Using these relations, formula (7.4.47) implies that the transformed sequences { f r (k )} 
have the following properties: 


fo(k) E R for k = 0,1,... , N — 1, 

fr(k) = fl r (k) for k = 0,1, ... , N - 1, (7.4.50) 

7s {/* (k) W k Z 2 } =0 for k = 1 , ... , N — 1, r = m/2 and m even. 


Thus, we perform only m 2 + 1 sets of 7V-point FFT computations to compute f(t) at 
t = kAT for k = 0,1,... , N — 1. Suppose the computed sequences are {fr(j)} N 
at r = 0,, 1,... , m 2 . Then 


f(kAT) = (-1) 


kn 


a ckAT 


2mT 


f(k), 


(7.4.51) 


where 


f(k) = { 


fo(k) + 2 E 3? {/r(fc)} cos 9 {fr(k)} sin 

for m odd, 

fo(k) + 2J2 3? {fr(k)} cos ^ ifr(k)} sin 2lrkrl 

r =1 L 


mN 


+ ^{fm 2 (k)} 


cos kir/N 


mN 1 
for m even. 

(7.4.52) 


7.4.7. Use of the FHT Algorithm. (Hwang et el. 1991) Formula (7.4.45b) 
usually provides improved accuracy in computing the indicial function f(t), but it 
also generates a faster FHT algorithm. From (6.7.2a,b) we note that the discrete 
Hartley pairs are given by 


A—1 


H (k) = cas ^T’ = 7 T H ( fc ) cas 


N -1 


3 = 0 


fc =0 


2irjk 

N ' 
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Note that H(k) and h(j) are denoted by and h 3 in the DFT formulas. Let 
H r (k) = ^2 h U) cas ~^~’ 

3=0 

and define the above transforms by the double-arrow relation 

{ H r(.k)} N <—> {h r (j)} N , r = -mi,... ,-1,0,1,... ,m 2 . (7.4.53) 

Let { H r (fc)} v be the output of the FHT subroutine with {//,.(})} v as the input data: 

4-4 2irjk 

H r (k) = h r {j) cas——, fc = 0,l,... ,N -1, 

3=0 

H r (k) = ^{f r (k)} + ^s{f r (N-k)} for fc = 0,1,... ,N — 1, 
and r = —mi,... , —1,0,1,... , m 2 . 

Since f*(k) = f- r (k), we get 

H 0 (k) = f 0 {k) for fc = 0,1,... ,N — 1, 

H-r(k) = 3?{/-r(*)} + 9 {f-r(N ~ k)} 

= $i{fr(k)} -Q{f r (N - fc)} forr = 1,2,... ,mi, 

which gives 

®{fr(k)} = \ [Hr(k) + H-r(k)} , 

^ {fr(k)} = \ [H r (N - fc) + H_ r (N - fc)], 

for k = 0,1,... , iV — 1 and r = 0,1,... , mi. Also, 

w~ k/2 f m/2 (k) = H m/2 (k) cos + H m/2 (N - k) sin form even. 

Thus, we have the approximation formula for /(£) at t = A: AT, developed by Hwang 
etal. (1991): 

p ckAT ?T 2 /i z' ‘lirkr 

'- 1 * 1 ["»<*> + £ { + H -W 

Oqrhr 'l " 

— [JT r (iV — fc) + H_ r (N — k)} sin —— j for m odd, 

~ p ckAT r 7 , 7, 

/(fcAT) = ^ (-l) fc ^- [ffo(fc) + ff m/2 (fc) cos — - H m/2 (N - fc) sin — 

Tn\ s ‘lirkr 

+ E { [^r(fe) + ff-r(fc)] COS — 

Oqrhr 'l " 

— [i? r (A — fc) + H_ r (N — fc)] sin —— j for m even. 

m (7.4.54) 
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This formula performs m sets of 7V-point real FHT computations as compared to 
formula (7.4.52) which performs m 2 + 1 sets of 7V-point FFT computations. Thus, 
formula (7.4.54) provides a significant reduction in computer time. 

Example 7.4.12. (Hwang etal. 1991) Consider three functions: 

(0 fi(s) = 2 * T7 ’ AW’ for c = -0.05; 

(ii) /2(s) = ( s + q2)2 + 1 ’ = e_0 ' 2 ‘ sini ’ for c = 0- 05 ; 

(iii) h{s) = , f 3 (t) = te~\ for c = -0.5; 

(iv) U(s) = yT , f 4 (t) = sinf for c = 0.2, 

S T~ 1 

and compute the following two precision measures, which are modifications of those 
proposed by Davies and Martin (1979) (see §7.1) and defined by 


L x 


L 2 


\ 

\ 


Y (/(0.25J) - /(0.25 j)) . 

3 = 0 

63 2 63 

(X) (/(0-25 3) - 7(0.25 j)) ) / ( E 

i =0 1=0 


g—0.251 


)• 


where Li provides a fair test for successful computation for large t, and that for 
a relatively smaller t (compare L\ and L 2 with L and L e in (7.1.17) and (7.1.18)). 
These measures are computed for all these functions for m = 1(1)4 and n = 1(1)8. 
We present these values only for the case (ii) in Table 7.4.12; other results are available 
in Hwang etal. (1991). ■ 

The FFT method uses the time duration T max = 2 T to control the accuracy 
of the trapezoidal rule approximation (7.4.52), and thus it requires a large data set 
of complex FFT computations to obtain the function f(t)\ sometimes it produces 
inaccurate results for t > T max /2. But the FHT formula (7.4.54) overcomes these 
disadvantages, since it takes a step size of Acj = tt/( mT) for the trapezoidal rule 
approximation which has an adjustable parameter m to control the order of precision, 
aliasing error, and computer cost. 

D’Amore, Lacceti and Murli (1999b) have used the method based on the Fourier 
series expansion of f(s) and produced a Fortran package INVLTF with subroutines 
QDACC and BACKCF, which uses the QD algorithm. This software is especially 
suitable when /(s) is sectionally continuous. It is tested on f(s) = 1/ (s 2 + s + l). 
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Table 7.4.12. 


n 

m = 1 

m = 2 

m = 3 

m = 4 

1 

Li = 0.74037(—2) 

0.61647(—3) 

0.58686(—3) 

0.60383(—3) 


L 2 = 0.18549(—2) 

0.24925(—3) 

0.24789(—3) 

0.18085(—3) 

2 

Li = 0.72764(—2) 

0.20120(—3) 

0.91758(—4) 

0.92917(—4) 


L 2 = 0.13962(—2) 

0.24346(—4) 

0.41904(—5) 

0.30473(—5) 

3 

Lx = 0.73138(—2) 

0.14782(—3) 

0.49566(—4) 

0.53966(—4) 


L 2 = 0.13794(—2) 

0.36570(—4) 

0.28310(—4) 

0.20625(—4) 

4 

Li = 0.73053(—2) 

0.14726(—3) 

0.12218(—4) 

0.13331(—4) 


L 2 = 0.13764(—2) 

0.24276(—4) 

0.65629(—4) 

0.38485 (—6) 

5 

Lx = 0.73107(—2) 

0.14144(—3) 

0.17010(—4) 

0.18792(—4) 


L 2 = 0.13765(—2) 

0.26006(-4) 

0.10281(—4) 

0.74696(-5) 

6 

Lx = 0.73085(—2) 

0.14269(—3) 

0.36080(-5) 

0.40975(-5) 


L 2 = 0.13758(—2) 

0.24264(—4) 

0.54188(—6) 

0.12153(—6) 

7 

Lx = 0.73101(—2) 

0.14100(—3) 

0.89883(-5) 

0.95697(—5) 


L 2 = 0.13760(—2) 

0.24657(—4) 

0.52832(—5) 

0.38213(—5) 

8 

Lx = 0.73094(—2) 

0.14162(—3) 

0.24154(—5) 

0.17634(—5) 


L 2 = 0.13757(—2) 

0.24270(—4) 

0.59861(-6) 

0.58828(-7) 


7.5. Use of Bromwich Contours 

A Bromwich contour method is discussed for functions that have singularities. 

7.5.1. Talbot’s Method. Talbot (1979) uses the trapezoidal rule for the 
inversion of the Laplace transforms and computes the Bromwich integral (7.1.2) 
by computing it along a special contour which is defined below. The Bromwich 
contour in (7.1.2) from c — iootoc + ioo, where c > cq, is chosen such that 
it is to the right of all singularities of f(s). However, the trapezoidal rule fails 
to give accurate results along the Bromwich contour because of the oscillations of 
e st as —» Too. This difficulty was overcome by Levin (1975) who used 

his convergence-acceleration algorithms, although his method failed to achieve the 
error bounds of orders O (lO -12 ) to O (lO -15 ). Talbot’s method circumvents this 
difficulty by changing the original Bromwich contour to a contour Y in such a way 
that the trapezoidal rule becomes more accurate. The contour Y starts and ends in the 
left half-plane so that $l{s} —» — oo as s ^ c ± ioo and encloses all singularities of 
f(s) such that /(s) —» 0 uniformly in < Co as \s\ —> oo. This method requires 
that (i) ^s{s } remain bounded as \s\ —> oo in order to limit the oscillations of e xs , 
and (ii) ?R{s} —» — oo so that e xs decays rapidly. In the case when the contour Y 
does not enclose all singularities of f(s), we consider a modified function / (A 5 + a) 
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by a suitable magnification parameter A and a suitable translation cr; then, if, for 
example, f(s) has a singularity at so, then /(As + cr) will have this singularity at 
Sq = (so — cr) /A, and the integral (7.1.2) is replaced by 

f(t) = J e Xst f(\s + a) ds, t > 0. (7.5.1) 

In the particular case when f(s) = 1/s, the contour T can be the steepest-descent 
contour for the integral (7.1.2) for t > 0. Then one can use the trapezoidal rule to 
evaluate this integral, using the parametric definition of the contour. In the general 
case, let M denote the imaginary interval —2tt i < s < 2iri , and lets = S(z) be areal 
uniform analytic function ofz = x-\-iy such that it (i) has simple poles at =L 27 ri, (ii) 
has no singularities in the strip \y\ < 2i r, (iii) maps the interval M one-to-one onto a 
contour T that is traversed upward in the s-plane such that T encloses all singularities 
of /(s) (or /(A s + cr)), and (iv) maps the half-strip H : {x > 0, \y\ < 2i r} into the 
the exterior of T. Then (7.5.1) can be written as 

f(t) = A- f Q( z )dz = / f Q(iy)dy, (7.5.2) 

2tti J m 2i r 7_27r 

where 

Q{z) = A e ( AS+<J ) t /(A S + cr) S'(z). (7.5.3) 

Note that in view of (i) and (ii), 3ft{s} —> oo on T as z ±27ri on M, and Q(±27ri) = 
0. Also, the condition (iii) depends on both / and S but cannot be satisfied if /(s) has 
infinitely many singularities whose imaginary parts extend to infinity. These are the 
only kind of inverses f(s) which cannot be inverted by this method. Thus, excluding 
such functions f(s), we apply a trapezoidal rule to (7.5.1) and obtain the general 
approximate inversion formula: 

9 2 kiri 

f(t ) = - y] ' {<2 (z*:) }, where z k = —, (7.5.4) 


where f(t) approximates the indicial function f(t). Now, consider a family of map- 

+ a z, where v > 0 


pings defined by s = S v (z) = ^ ^coth ^ + i^j 


1 — e~ 


is an arbitrary parameter and a = {y — l)/2. The singularities of S v (z) are the 

simple poles at ±2rmi, n = 1,2,-The function S u (z) maps the interval M onto 

a contour Y v defined by 


Y v : 8 = cr T A s v (6) = cr + A (a + ivO) , —i r < 6 < 7r, (7.5.5) 

where a = 6 cot 6. The contours Y v are known as the Talbot contours , some of 
which are presented in Fig. 7.5.1 (see page 540), with the following legend: Ti for 
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cr = 1, A = 1, v = 1; V 2 for a = 2, A = 1, v = 1; for cf = 1, A = 1, v = 2; and 
Ti for cr = 2, A = 1, ^ = 2. 

On F v we have S£,(z) = s' v (Q) = + 7 (3) /2, where (3 = (3(0) = —da/d6 = 

0 + a(a — 1)0. Then the approximation (7.5.4) becomes 

. at n —1 

/ft) = — — N ' ^{(^ + eSt,T /(O' + a s u ) I , (7.5.6) 

n k=i <- )e=e k 

where r = Xt, and 0& = kir/n, k = 0,1,... ,n — 1. If / (cr + A s^) = G + iH, 
then (7.5.6) takes the real form 

\ o-t n ~ 1 

/ft) = -E- V ' [e“*| (uG-pH) cos( i/0t) - (vH + pG) sin( i/0t)1 

71 L L J 0=0i 

k =1 

(7-5.7) 

The error in this formula is given by T(£) = Ti (£) + E 2 (t), where TA = f(t) — f ( t) 
is the theoretical error and has a bound of order O (^ 2 e ht ~ h VrE+°t^, anc [ ^ anc [ 5 are 

constants. Talbot (1979) has shown that both > 0 as n —> 00. The predicted 

error in the formula (7.5.7) is then given by 

To = 1 e ( AS (°)+ CT )« /(AS'(O) + cr) S"(0), (7.5.8) 

If the computer evaluates To correct to d significant digits, the round-off error E r in 
/ is approximately E r = (l0~ d T 0 ), and all other round-off errors are negligible in 
its comparison. Hence, the actual error in / is E = E\ + E 2 + T r « O (l0 -d To) 
for sufficiently large n. Talbot (1979) has considered a set of twenty cases of Laplace 
inverses, which are given in Table 7.5.1. 

An implementation of this method is given in Murli and Rizzardi (1990) where 
two computer routines are available. Given the points x where the Laplace transform 
is to be inverted, the locations and types of the singularities of /, and the desired 
accuracy, the first routine computes the parameters cr, A, and v , while the second 
routine applies the trapezoidal rule using n points which are equally spaced. The 
contour is parametrized by s(0) = a + A s u (0), 0 E (—7r,7r), where s v (6) = 
6 cot Q + ivQ. Then formula (7.5.1) becomes 

/ft) = f e xts ^ f (a + Xs v {9)) s' v {6)de , 

///ix -f 0 cos 0 sin 0 'i . _ 

4ft) = T+ -- • (7-5-9) 

l sin 6 J 

Using symmetry, the trapezoidal rule approximation gives 

Xe at 

/ft) = —T„ft), 

77 1 

T n ft) = ^"e At ^^)/( ( 7 + A S ,( 0)) ^4ftft), 9j = 3 —. 

3 =1 * n (7.5.10) 
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Table 7.5.1. 


m 


nt) 


i. 


2 . 


1 


V^I 

e -s/V«+1 


3. e“^ 


4. - 

(s + 1) 5 

999 

' (s + l)(s + 1000) 

7 e + In s 

6 .- 

s 


>/5 + Vs + l 

e -1 / s 


9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20 . 


■T* 

tair ‘ (i) 


Vs 2 +1 

1 

V s + Vs 2 + 1 
\/s + \/s 2 + 1 

v^TT 

Q + A^+I) 372 

Vs 2 + 1 

\/s + V^ 2 + 1 e s_ ^ s2+1 

Vs 2 +1 


(■s 2 +1) \/sTT 


S 4 + 4 


s 4 — 1 
1 

(s 2 +1) 2 

o2 


S 3 +8 



Io(t) 


2Vrt^ eXP ( 4t) 

t 4 e 4 
24 

e" 4 - e- 1000t 


hit, 7e = 0.5772156649 

1 -e~ 4 

vVt 3 

cos 2\/t 

\fwt 
sin t 

t 

Mt) 

sin t 
V2 tt t 3 

r.2 . 

\ / — sin t 
V 7ft 


vi (sin7 


cost) 


7r(t + 2) 


sin \/ t(t + 2) 


cost cosht 
sinh t — sin t 
2 

sin t — t cos t 

2 

e -24 — 2cos(\/3t) e 4 

3 

2 (cos2t — cost) 
t 
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In the sum (7.5.10), the j = n term is zero and the j = 0 term is — e Xt f(a + 

A). Talbot (1979) uses the following values: A = ——- + —, uo = 0.4 (d + 1), 

t 30 

where d denotes the decimal machine precision. But Murli and Rizzardi (1990) use 

uo -1 1 

A =-1 —-= with the same value of uo as in Talbot’s case. The procedure 

t v UOt 

overflows when t > 10 3 . They increase nton' = n log 2 (t) when t > 10. With 
this modification their result is correct for t < 10 5 . For large t the overflow problem 
remains, but it can be mitigated by increasing A. Since Murli and Rizzardi’s software 
is available, we will not discuss it further. 


Rizzardi (1995) has generalized Talbot’s method to approximate simultaneously 
several values of f(t) using the same sampling values of the Laplace transform. This 
method eliminates the only unfavorable aspect of Talbot’s method, which consists in 
recomputing the values of / (s) for each t. The test functions used are: /i (s) = 1 /s 2 , 
Ms) = 1 /(s - 1), Ms) = arctan(l/s), and / 4 (s) = s 2 / (s 3 + 8). 


7.5.2. Duffy’s Method. Duffy (1993) has tested the following three methods 
on complicated transform function: (i) Trapezoidal rule, (ii) Weeks’ method using 
Laguerre polynomials, and (iii) the classical Talbot’s method. The test functions are: 


!• f( s ) = 


1 


s(s + c) 
inverse is given by 


1 

2 hs 



, where c and h are real parameters. The 


m 


i 

2c 



e 2hc I 
e 2hc - 1 . 


7 OO 

h ^ 

7r ^ 

n =1 


. r riTVL f 'MV \ 

sin —-arctan -— , 

L h _ \ he/ J 


i \Jn 2 Tv 2 + h 2 c 2 


This inverse arises in circuit theory (McLachlan 1953, §8.63). 


2 - f(s) = 


(100 5 — 1) sinh (v^-/2) 


s [5 sinh i 
axis at s = —b 2 , where b 1 


fs + cosh yds] 
tan b n = 1. The inverse is given by 


, which has poles on the negative real 


nt) 


E 

n =1 


100 


1 

b 2 


2 b n sin (b n / 2 ) e b ^ 
(2 + bl) cos b n 


This inverse is encountered in the study of longitudinal impact on viscoplastic rods 
(Ting and Symonds 1964). 

3. f(s) = - e _a V /s ( 1 + s )/( 1+cs ), which has the inverse 


m 


1 

2 


1 



x sin 


/ 


tu — am 


ydri/2 (cos 0 — sin 0) 

\Juj 2 (cos 6 + sin 6) 


du 

u 
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/ 1 -f u 2 \V 4 

where m = (-) and 26 = arctan(xx) — arctan(cxx). This function arises 

V1 + c 2 u 2 J 

in the Rayleigh problem for a viscoelastic fluid (Tanner 1962). 

e - 2 T 

4. f(s) = -, where cosh 4/ = ^/l + s 2 + s 2 /16. The function /(£) is 

given by 


/(*) 


i 



sin(xx/; + 2fc) 


sin(xx/; — 2 k) 


du 

u 


1 

7T 



sin(xx/; + 2 k) 


— sin (ut — 2k) 


du 

u 


where cos k = \ y/(u 2 — u 2 ) (u^ — u 2 ), and 14,2 = 2 \/2 =p \/3 • This function 
appears in the study of shock waves in diatomic chains (Musgrave and Tasi 1976). 


5. f(s) 


s — Vs 2 — c 2 

yds Vs 2 — C 2 \/s — N Vs 2 — C 2 


, N < 1, which gives 


2 f c Uy/(R + u)/2 + Jc 2 -u 2 yf[R-u)/2 

f(t) = - / cosh(to)- —-, 

7T 7o Rye 2 — U 2 y'U 

L 


2 

K Jo 


. — \/c 2 + u 2 


u ye 2 + u " 


'V^Vf 


cos(txx) du , 


Cr + Xir — IX 


where i? = ^ (u 2 + N 2 Vc 2 - u 2 ,b = yV - N)/{1 + N), andc = (l-iV)/JV. 
This function arises in the theory of beams (Boley and Chao 1955). A couple of joint 
Fourier-Laplace transforms are also discussed. 


7.6. Inversion by the Riemann Sum 

(Tzou, Ozisik and Chiffelle 1994, and Tzou 1997) Assuming that the real number c 
in definition (7.1.2) of the inverse f(t) is taken to the right of all singularities of f(s ), 
and substituting s = c-\-iu, we can write 

-I rC+lOO _ ct POO 

— / f( s )e st ds=— /(c + ^dw. (7.6.1) 

</ C—700 J —OO 

Replacing uj by ^ and A uj n by 7r/r, the integral on the right side of (7.6.1) can be 
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expressed as a Riemann sum: 


e 

27r 


r e /(«+— 

^ 00 ^ n=—oo ' 

/(c) + E [/ ( c + t 1 ) einxt/T + f (■ 

n=l ' ' ' 


7T2/7T \ ififft/r 


e ct 

2t 

siCt 


c in'TT ^j ^-i n 7 rt /7 


1 - 




0 i nirt/r 


Then for r = /, we get 


m = 


{£/(-=) 

v n=l x ' 

(r.6.2) 

/(«) + W {£(-1)" /(e+ }1. (7.6.3) 

^ n=l ' -* 


1 - 
2 


Thus, integration is reduced to an infinite series. The accuracy of formula (7.6.3), 
which was also given by Crump (1976), depends on the choice of c and N. Note that 
formula (7.6.2) is equivalent to formula (7.4.28). According to Tzou et al. (1994) and 
Tzou (1997), the best choice for c appears to be 4.7//. The disadvantage, as Crump 
(1976) points out, is that one has to choose a different c for each /. But this can be 
remedied by replacing ct by b and changing formula (7.6.3) to 




7 [MU *{£,->>"/(? Y)} 

L v n=l ' 


(7.6.4) 


Also note that formulas (7.6.4) and (7.4.32) are closely related. 

_ g 

Example 7.6.1. Consider /(/) = 0.5/sin/, for which f(s) = and 

s ~\~ 1 

e -10s 

/(/) = U(t — 10), for which f(s) = -. The values of approximate /(/) obtained 

from formula (7.6.4) are given in Table 7.6.1. There is no change in these values for 
n = 1000 or 10000. Since formula (7.6.4) has singularity at / = 0, we have evaluated 
/(/) at / = 0.0001. For computational details see tzou .nb on the CD-R. ■ 

Example 7.6.2. Jordan et al. (2000) have used this method to compute the 
following two inverses: 

fi(s) =- [ g(u,x,t)dt , / 2 (s) = e~ x / b — 1 + [ h(u,x,t)du , 

A" Jo Jo 


where 


g(u,x,t) 


ue tu 2 /( 1 u ) 2 s i n[xj(u)] 

(1 — u)y/(l — u ) 4 + 2 u 2 (2 b 2 — a 2 ) (1 — u ) 2 + a A u A ’ 
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h(u,x,t) = 


K u ) = 


(1 — u)e tu u ) sin[xj(^)] 


(1 — u)^J(l — u) 4 + 2i^ 2 (2b 2 = a 2 ) (1 — i^) 2 + a 4/ u 4 


6(1 — ?/) 


Ia 2 u 2 — (l — ?/ 2 ) + y/(l — i^) 4 + 2i^ 2 (2b 2 — a 2 ) (1 — u) 2 + a 4 ^x 4 


Table 7.6.1. 


t 

0.5 1 sin t 

(7.6.4) 

U(t - 10) 

(7.6.4) 

0 

0.00000 

5.00372(—9) 

0.0 

0.00000 

1 

0.42073 

0.42075 

0.0 

3.87(—21) 

2 

0.90929 

0.90922 

0.0 

3.41(—9) 

3 

0.21168 

0.21183 

0.0 

6.83(—9) 

4 

-1.51360 

-1.51387 

0.0 

8.25(—5) 

5 

-2.39731 

-2.39691 

0.0 

8.27(—5) 

6 

-0.83824 

-0.83880 

0.0 

7.47(—5) 

7 

2.29945 

2.30018 

0.0 

5.61(—5) 

8 

3.95743 

3.95653 

0.0 

0.00020 

9 

1.85453 

1.85560 

0.0 

-0.00003 

10 

-2.72011 

-2.72133 

0.5 

0.49960 

11 

-5.49995 

-5.49858 

1.0 

1.00178 

12 

-3.21944 

-3.22091 

1.0 

1.00103 

13 

2.73109 

2.73264 

1.0 

1.00132 

14 

6.93425 

6.93266 

1.0 

0.99881 

15 

4.87716 

4.87874 

1.0 

1.00008 

16 

-2.30323 

-2.30475 

1.0 

1.00147 

17 

-8.17188 

-8.17046 

1.0 

0.99826 

18 

-6.75889 

-6.76013 

1.0 

1.00108 

19 

1.42383 

1.42486 

1.0 

0.99797 


7.7. New Exact Laplace Inverse Transforms 

Since the publication of tables of Laplace inversion formulas published in Erdelyi et al. 
(1954), Roberts and Kaufman (1966), Abramowitz and Stegun (1968), Oberhettinger 
and Badu (1973), and others, some new exact inversion formulas have been published 


2005 by Chapman & Hall/CRC Press 





7.7. NEW EXACT LAPLACE INVERSE TRANSFORMS 


395 


in research j oumals. An attempt has been made to collect all such formulas and present 
them as the file NewLaplacelnverses .pdf which is available on the CD-R. These 
new formulas are taken from the work of Hetnarski (1964, 1975), Gridamo (1974), 
Puri and Kulshrestha (1974), Puri (1984), Puri and Kythe (1988), Jordon, Puri and 
Boros (2000), and Jordan, Meyer and Puri (2000). This pdf file may not be complete. 
In that case the readers are encouraged to point out the publications where we have 
missed other exact new inversion formulas. We will present such new formulas on 
our website and acknowledge the individuals for their contribution. 
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Wavelets 


To some extent wavelets are no more different than other orthogonal systems. They 
are an extension of Fourier analysis and used to represent a function by a series 
of orthogonal functions, but with these differences: The wavelet series converge 
pointwise, are more localized, exhibit edge effects better, and use fewer coefficients to 
represent certain signals and images. However, wavelet expansions undergo excessive 
changes under arbitrary translations, which makes the situation much worse than the 
Fourier series. We study wavelets in the same manner as in the previous chapters 
with other orthogonal systems, in particular with orthogonal polynomials and Fourier 
series. Wavelets are computed by fast transforms. 

Orthogonal series have been used since their inception and Fourier provided the 
trigonometric Fourier series to solve partial differential equations of heat conduction 
and wave propagation. Orthogonal polynomials, like Legendre and Hermite, are used 
in solving the Laplace and Schrodinger equations. They have been extensively used 
in Gaussian quadrature. We will study the unique properties of the orthogonal (and 
orthonormal) sequences of wavelets and their transforms. 


8.1. Orthogonal Systems 

A nontrivial sequence {f n }^_ 0 of real (or complex) functions in L 2 (a, b) is said to 
be orthogonal if (/ n ,/ m ) = f n (x)f^ l (x) dx = 0 for n ^ m, where n,m = 
0, 1, 2,.. ., and orthonormal if in addition (/ n , f n ) = 1 for n = 0, 1, 2,- 

Example 8.1.1. The sequence {f n } = { sin(n + l)x} is orthogonal on 
(0,7r). ■ 


396 


2005 by Chapman & Hall/CRC Press 



8.1. ORTHOGONAL SYSTEMS 


397 


Example 8.1.2. The sequence {/ n (x)}, where 


fn X[n,n+1 )(t) 


1, n < x < n + 1, 

0, elsewhere, 


is orthonormal on [0, oo). ■ 

Given a function f(x) G T 2 (a, 6), we seek to expand it in an orthonormal series 


f( X ) = ^2 C nfn(x). ( 8 . 1 . 1 ) 

n=0 

If this is possible, the coefficients c n must have a special form (this is not always the 
case is obvious if we take f{x) = X[i/ 2 ,i)( x ) in Example 8.1.2). In fact, let {c n } 
be a sequence such that the series ( 8 . 1 . 1 ) converges to f(x) in the L 2 -norm, defined 

by ||/||2 = (/, /) • Then c n = (/, / n ), and the mean-square error is given by 

N 

E n = ||/ — XI c n /n||- The expansion (8.1.1) is always possible if c n are Fourier 

n=0 

coefficients. Thus, if {c n } is the sequence of Fourier coefficients of / E L 2 (a, 6 ) and 

oo oo 

if {a n } is any other sequence, then \\f - c n /„|| 2 < ||/ - X /n|| 2 ; i-e., the 

n= 0 n=0 

mean-square error is a minimum for the series with Fourier coefficients. We can also 
say that the Fourier coefficients give the orthogonal projection of / onto the subspace 

N N 

V n spanned by (/ 0 , /i,... , f N ), and ( J2 c n fn, f ~ X c n fn) = 0; i.e., the best 

n= 0 n= 0 

approximation to / in Vn is given by this sum, and the error E n is orthogonal to 
Vn- Moreover, the orthonormal system {f n } is said to be complete in L 2 (a, b ) if 
no nontrivial / E L 2 (a, 6 ) is orthogonal to all / n ; i.e., (/, f n ) = 0 , n = 0 , 1 , 2 ,... 
implies that / = 0 almost everywhere. Thus, if {/ n } is an orthonormal system in 
L 2 (a, 6 ), and if the expansion of / E L 2 (a, 6 ) has the Fourier coefficients {c n }, then 

N 

11/ - E c n /nil o as N -► oo iff {/ n } is complete. 

n=0 

For any orthonormal system {f n }, we have Bessel’s inequality 

( 8 - L2 ) 

k 

where equality occurs if the system is a basis for L 2 (R) . Conversely, if an orthonormal 
system {/ n } satisfies the condition 

E M = 11/111 (8-1.3) 

k 

for all / G L 2 (i?), then the system is a basis for L 2 (i?). We will discuss some 
orthonormal systems in detail in the following sections. 
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8.2. Trigonometric System 


This system, defined by fo(x) = fi(x) = sinx, f 2 (x) = cost, .. f 2 n-i(x) = 
sinnx, f2n(x) = cos nx, ..is a complete orthogonal system in L, 2 (— 7r, 7r), but it 
is not orthonormal since \\f n || 2 = 7r for n ^ 0. The trigonometric series is written as 


s(x) 


a o 

T 


oo 

+ (a n cosnx + b n sin nx), 

n=l 


( 8 . 2 . 1 ) 


and if the series s(t) is the Fourier series of a function / e I/ 2 (—7r,7r), then the 
coefficients a n and b n are given by 


1 

ao = — 
7r 




1 

7T 



cos nx Pc, 


n = 1, 2 ,... . 


Lets n (T) = — + j>2 ( a,k cos kx - 
2 k =l 


bk sin kx) denote the partial sum of the Fourier 


series for/. If/isa27r-periodicfunctionin(7 2 (P), thensup^^ |s n (T) —/(t)| —> 0 
and || s n — /|| —> 0 asn —> oo; i.e., the series s(x) converges uniformly to a limit 
function / which is 27r-periodic and continuous. The Fourier series (8.2.1) for a 
2P-periodic function / becomes 


„ , % . , XL1XX „ . T17TX \ . ^ % 

/(a;) = cos -p- + sin J, (8.2.2) 

n =1 


where 


A 

B 


1 


2P 
_ 1 
“ P 



= 



. T17TX 

sm — 


Pc, 


1 

P 



tvkx 
cos — 


Pc, 


n = 1, 2 ,... . 


The Dirichlet kernel D n (u) is defined by 


D n {u) 


1 ri 


7T L2 


n 

COS ku 

k=1 


sin(n + 1/2)tx 
27t sin(?x/2) 


(8.2.3) 


and is such that D n (u) du = 1. 
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If / is piecewise continuous on every finite interval and \f(x)\dx < oo, 
then / has the Fourier integral representation 

rOO 

f(x) = / [^(7) COS7T + B( 7) sin 70;] dx, —00 < x < 00, ( 8 . 2 . 4 ) 

Jo 

where for all 7 > 0 

21(7) = — / f(x) cos7 tdt, B(j) = — f(x) sin7 tdt. ( 8 . 2 . 5 ) 

The integral in (8.2.4) converges to f(x) if / is continuous and to 4 [/(x+) + f(x— )] 
otherwise. Note the similarity between the Fourier integral (8.1.5) and the Fourier 
series (8.2.2). Suppose that / is integrable on the real line, and we restrict / to a 
finite interval (—P, P). We take the part of / that is inside (—P, P) and extend its 
periodicity outside this interval. This periodic extension agrees with / on (—P, P) 
and has the Fourier series (8.2.2), which represents f(x) for x G (—P, P). Then what 
happens to this representation as P —> 00? To answer this question, we examine the 
Fourier coefficients as P —> 00. Since / is integrable, it follows that A 0 —> 0 as 
P —> 00. Also, a relationship between A n , B n and ^(7), B( 7), respectively, can 
be established as follows. The integrability of / implies that the integrals in (8.2.4) 
can be approximated by integrating over the (large) finite interval (—P, P). The 
difference is just the tail ends of the integrals, which can be made arbitrarily small. 
Thus, by (8.2.5) for large P we have 

An ~ p / C ° S dx = A Otn) A 7 , 

where 7 n = mr/Pand A7 = n/P. Similarly, B n « B (7^) A7. Substituting these 
values in ( 8 . 2 . 2 ) we find that for very large P 


00 

/(*) = H 7 (7„) cos7 n x + B (7„) sin ^ n x\ Ay. (8.2.6) 


n=1 


The sum in (8.2.6) is a Riemann sum, which samples the integrands of (8.2.5) at 
equally spaced points j n with a partition size A7 which is exactly the distance 
between two consecutive j n . Since n —> 00 in (8.2.6), the Riemann sum in (8.2.6) 
is not taken over a finite interval but spans the entire nonnegative 7-axis regardless 
of P. Then as P —> 00, we have A7 —> 0 and this Riemann sum converges to the 
integral given by (8.2.4). 

Example 8.2.1. To find the Fourier representation of the function 

if \x\ < 1, 
otherwise, ’ 
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note that A ( 7 ) = 


2 sin 7 

7T7 


, B( 7 ) =0 (since / is even), and for \x\ / 1 we get 


,, N 2 f sin 7 cos 72 ; . 

/OO = - / -d7- 

Jo 


Jo 7 

For x = =bl, which are the points of discontinuity of /, we obtain the value \. Hence, 



sin 7 cos yx . 

- 0(7 

7 


1 if |x| < 1 , 
< if |x| = 1 , 
0 if |x| > 1 . 


If we set x = 0 in the above integral representation of /, we obtain the Dirichlet 

sin /v 'jy 

integral J 0 °°- - dy = —, which is a special case of (8.2.3). ■ 

7 J 

Let the partial Fourier integral of / be denoted by 


rn 

S n (x) = / [y4(7) COS 7 T + 5 ( 7 ) sin 70 ;] dy, n > 0 , (8.2.7) 

Jo 

where A( 7 ) and 5 ( 7 ) are given by (8.2.5). Then lim 5 n (x) = \ [/(x+) + /(x—)]. 

71—s-OC “ 

The Fourier integral, like the Fourier series, exhibits a Gibbs phenomenon near a 
point of discontinuity. We introduce the sine integral function 

rw \ r 7 

bi(x) = / - dt, —00 < x < 00 . 

Jo ^ 


Then lim Si(x) = 7 r/ 2 . 

x—>oo 

Example 8.2.2. The partial Fourier integral for the function f(x ) in Example 
8 . 2.1 is given by 


5, 


, x 2 r, 
J x ) = ~ / ' 

^ Jo 


sm 7 cos yx 


dy 


o 7 

sm 7 (l + x) sin 7 (l — x) 


1 f n rsm 7 (l + x) 807 ( 1 - 1 ]] 

~ ) -1-r “7 

7T Jo 1 A 7 J 


/ 


7 

n(1+x) sin?/ /* n(1 - x) 


■ du - 

u jo 


f 


smu 


du 


= — [Si (n( 1 + x)) + Si (n(l — x ))]. 

7T 


( 8 . 2 . 8 ) 


The graphs of S n (x) for n = 1,4, 6 , 8 ,10 are given in Fig. 8.2.1 (see page 541), 
where the Gibbs phenomenon at the point of discontinuity of / is exhibited by the 
overshooting of the graphs beyond their limiting values. ■ 


2005 by Chapman & Hall/CRC Press 














8.3. HAAR SYSTEM 


401 


Littlewood-Paley Theorem. (Littlewood and Paley 1931,1936) Using 

oo 

the Fourier series f(x) = ao + XI ( a k cos kx + bk sin kx), we define the ‘dyadic 

k =l 

blocks’ A jf(x) by 

A if( x ) = T (a& cos kx + bk sin kx) . (8.2.9) 

2- 7 </c<2- 7 + 1 
oo 

Then f(x) = ao + XI A jf(x ). Littlewood and Paley (1936) prove that there exist 

j=0 

two constants C v > c p > 0 for 1 < p < oo such that 

cxi 1 /2 

C P ||/ P ||< (|ao| 2 + X!lAi/(*)| 2 ) <c p ||/|| p . (8.2.10) 

j=o p 

This result is sharp for p = 2 and C p = c p = 1. 


8.3. Haar System 

In the sequel the letters j, /c, /, ra, n,p and r denote integers. To discuss the Haar 
orthogonal system we first consider the interval [0,1) and start with the characteristic 
function of the unit interval 

Ht) = X[o,i)(t), (8.3.1) 

which is known as the scaling function of the Haar wavelet (Haar 1910) defined by 

' 1, 0 < t < 1/2, 

fj(t) = -1, 1/2 <t< 1, (8.3.2) 

0, outside [0,1), 

such that Jf^fj^dt = 0 and ||'0(t)|| 2 = \fj(t)\ 2 dt = 1. The function 

fj(t) is also known as the mother wavelet of the Haar family; it is localized in the 
time domain but is not continuous. The father and mother wavelets are related by 

fj(t) = 0(2 1) — cj)(2t — 1). The first generations of the daughter wavelets are 

i’loit) = and ^n{t) = ^{2t - 1), 

and they are related to the father wavelet by 

ipio(t) = <H4i) - 0(4t - 1), ipu(t) = 4>(4:t -2) - 4>(4t -3). (8.3.3) 
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The plots of </>(*), ^(t), 'ipioit), and ^n(t) are given in Fig. 8.3.1 (see page 541). 
NotethatX[ 0 ,6)(4 = X[o,i)(t/b), and X[a,b)(4 = X[o,i We will sometimes 
use the following notation: 


^r m \t)=4> { o,i) (2”- m t-fc)=| 

^ n “ m) (4=^[0,i) (2 n ~ m t-k)=< 


1 if k2 m ~ n <t<(k + l)2 m ~ n , 

0 elsewhere, ^ ^ 

1 if k2 m ~ n <t<(k+ \)2 m ~ n , 

-1 if{k+\)2 m - n <t<{k+l)2 m - n , 

0 elsewhere. (8.3.5) 


form 


Let V n denote the set of all functions that are constant on the intervals of the 

jYl jjl 1 \ 

j of length 2 ~ n , where m = 0,1,... , 2 n — 1, and zero elsewhere. 


L2 n 2 

The set V n is also an inner product vector space of functions f(t) with a finite norm 
||/1| = yj (/, /). In particular, Vo is the set of all functions that are constant on the 


interval [0,1), and zero elsewhere; V\ is the set of all functions that are constant on 
the ‘halves’, i.e., on the intervals [0,1/2) and [1/2,1), and zero outside the interval 
[0,1); V 2 is the set of all functions that are constant on the ‘quarters’, i.e., on the 
intervals [0,1/4), [1/4,1/2), [1/2, 3/4), [3/4,1), and zero outside the interval [0,1). 
Then there is a 1-1 correspondence between Vo and R, between V\ and R 2 , between 
V 2 and R 4 , and so on. For example, the correspondence between V 2 and R 4 is given 
by 


fit) 


' a , 0 < t < 1/4, 

b , 1/4 <t< 1/2, 

< c, 1/2 <*<3/4, 
d, 3/4 < t < 1, 

, 0, elsewhere. 


Thus, we can write 



(8.3.6) 


' 1 ' 


' 1 ' 


' 1 ' 


0 1 

1 


1 


-1 


0 

1 

>, Ip *—» < 

-1 

0 

1 

0 

>, <p 11 *—» < 

1 - 

, 1 , 


, 1 , 


, 0 > 


, -1 , 


For example, in the case of i/j \ 1 the matrix representation means that it has the first- 
element value 0 in the interval [0,1/4), the second-element value 0 in [1/4,1/2), the 
third-element value 1 in [1/2, 3/4), and the fourth-element value —1 in [3/4,1). 

The second generation daughters , related to the set Vs, are 


•020 (t) = ip(4t), 1p22(t) = ^(4 1 - 2), 

Ip2i(t) = Ip23(t) = ^(4f - 3). (8.3.8) 
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The wavelets are ‘constant on the eighths’ (i.e., intervals of length 1/8), and a rela¬ 
tionship of the type (8.3.6) between Vs and R 8 can be easily established. For the plots 
of the wavelets (8.3.8), see Fig. 8.3.2 (see page 542). In general, for each positive 
integer n, the n-th generation of daughters has 2 n wavelets, defined by 

jj nk (t) = (2 n t — k) , 0 < k < 2 j — 1, (8.3.9) 

and there is a 1-1 correspondence between V n and R 2 . 

In view of (8.3.7) we can also denote the father wavelet <j)(t) as i) (t ), the mother 
wavelet as ^[ 0? i) (t ), and the first generation daughter wavelets as jjio (t) = ^[o, 1/2) (0 
and (t) = / 2 ,i) ( t ). Similarly, in view of (8.3.5) the second generation daughter 
wavelets are represented as 

^20 (t) = ^(4 1) = ^[0,1/4)(t), ^22 (* ) = ^(4 1 - 2) = ^[1/2,3/4)(t), 

^21 (t) = ^(4 1 - 1) = ^[1/4,1/2)(t), ^23 (t) = ^(4 1 - 3) = ^[3/4,1) (0- 


Let W denote a finite-dimensional subspace of V, and W 1 - the orthogonal com¬ 
plement of W 0 (also called the annihilator), i.e, W^~ = {v G V : (v, w) = 0 
for all w £ FF} (see Kreyszig 1978, p. 148). Then the orthogonal decomposition 
theorem states that any v G W can be uniquely written as v = w + w_l, where 
w G W and wi e W ± , i.e., V = W © W 4 -, and 


^ (v,w fe ) 
w = > —-- - — 

^ <Wfe,Wfe)' 


(8.3.10) 


The vector w is called the orthogonal projection of V onto W, and the vector wi 
the residual. 


Example 8.3.1. Using the basis 

E>2 = 


11 10 
11-10 
110 1 
1 - 10-1 


(8.3.11) 


the orthogonal projection of f(t) = t onto V 2 is 

f(t) = \ (j){t) = \ Ip(t) - | ip 10 (t) - l 

Also, ( 10 (t),jja(t)) = 0, which means that ^10 _L 'ipn. Note that B 2 is a basis 
for R 4 (or Vf). ■ 

The standard basis in R 4 is 


-1000- 
0 10 0 
0 0 10 
_0 0 0 1 _ 


(8.3.12) 
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The columns of this basis contain the functions 020, 02i, 022, and 023, respectively, 
which are defined by 

(p2o{t) = 0(2 2 f), 022(4 = 0(2 2 f - 2), 

<hi(t) = 0(2 2 f-l), 4>23{t)=^{2 2 t-3). (8.3.13) 

These functions are known as the second generations of wavelet sons. Their graphs 
are given in Fig. 8.3.3 (see page 542). In general, for each positive integer n, the n-th 
generation of wavelet boys are defined by 

0 n>fe (O = 0 (2 n t - k) , 0 < k < T - 1 . (8.3.14) 

Note that in view of (8.3.4) the second generation son wavelets can be represented as 


020 (4 = 0(4f) = 0[ O ,l/4)(4, 022(4 = 0(4f - 2) = 0[i/ 2 ,3/4 )(4> 

021 (t) = 0(4f - 1) = 0[l/4,l/2)(4> 023(4 = 0(4f - 3) = 0[3/4,l)(4- 

For a given n, the set S n denotes the set of 2 n functions {jp n k(f)} 2 k= J ■ The set S n 
forms a basis for the inner product space V n . The father wavelet 0(0 satisfies the 
dilation property : 

oo 

m= E c fe 0(2f-fc). (8.3.15) 

k=— oo 


For the Haar wavelet, the coefficients Co = c\ = 1 and c)j = 0 for j 7 ^ 0,1. The 
projection of 0n(O onto Vo is \ 0(t ), and 0 2 o(O = | 0(0 + | 0(0 + \ 0io(O- 

Example 8.3.2. We will write functions f(t) that belong to V 2 as a linear com¬ 
bination of the father, mother and the first generation of daughter wavelets. Consider 
a function f(t) defined by 


f(t) = < 


4 iff G [0,1/4), 

-1 iff G [1/4,1/2), 
1 iff G [1/2,3/4), 
-9 if fG [3/4,1), 


, 0 elsewhere. 


Thus, we determine the coefficients x = [xi, £2, T3, such that 

/(f) = x\ 4>(t) + x 2 0(f) + X 3 0io(f) + x 4 0ii(f ). (8.3.16) 

Since there is a 1 — 1 correspondence between V 2 and R 4 , we can write Eq (8.3.16) 
in the matrix form as 


"1 

1 

1 

0" 


' X\ ' 


' 4 ' 

1 

1 

1 

0 



> = < 

-1 

1 

-1 

0 

1 

< 


1 ' 

_1 

-1 

0 

1 _ 


, X4 > 


c —9 > 
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which is solved to yield [x\ x 2 £3 £4] T = [5/4 1/4 —13/4 23/4] T . The 
plot of f(t ) is given in Fig. 8.3.4 (see page 543). ■ 

In this example the vector b forms the signal f(t) and the elements of the vector 
x are called the wavelet coefficients. The process of solving the equation Ax = b is 
known as the decomposition of a signal into wavelet coefficients; the reverse process 
where the vector x is known and the vector b is to be computed is known as the 
recomposition of a signal from its wavelet coefficients. The (square) matrix is known 
as the (Haar) wavelet matrix for n = 2. This process can be easily generalized to 
involve the father, mother, and/-generation of daughter wavelets for j = 1,2 ,... ,n. 
Since B 2 is a basis for R 4 , we always obtain a unique solution for Eq (8.3.16); i.e., 
every / G V 2 can be uniquely expressed as a linear combination of 0, 0, 0i O , and 
0n. This is also true for V n . 

Since Vo C W then by the orthogonal decomposition theorem each function 
h G V\ can be written as / + g, where / G Vo and g G Vq~, i.e., V\ = Vo ® Vq~. 

Example 8.3.3. The projection of 0 10 G Si onto Vo is 

The residual which is the projection of 0io onto Vq 1 is given by 0io — | 0 = \ 0. ■ 

The space Vq~ is one-dimensional, because dim(Vi) = 2 and dim(Vo) = 1. The 
residuals of both 0i O and 0n are scalar multiples of 0. Hence, {0}, which arises from 
Si, is a basis for Vq~. In fact, 0 G Vi and 0 is orthogonal to all elements of Vo- Thus, 
we obtain another basis for V\. Since So = {0} is a basis for Vo and Co = {0} is a 
basis for Vo -1 > then by the orthogonal decomposition theorem B\ = S0UC0 = {0,0} 
is a basis for Vi. Similarly, C\ = {01fc}, where 0i/c(t) = 0(2t — k), k = 0, 1, 
is a basis for V±~. Continuing this construction to n, since V n C I 4 + 1 , we get 
V n+ i = V n © and this creates a basis of V^, given by = {0 n /c}, where 
^ ipnk(t ) = 0 (2— fc), k = 0, 1,... , 2 n — 1. Then T? n+ i = U is a basis for 
Vrc+i. In general, 



K = ^n+l © v n Li = (v;_ 2 ® VA 2 ) 0 vAj 

= ... = y 0 ® ® Y © • • • ® vAi- (8.3.18) 

Thus, B n is obtained from the standard basis S n , and B n provides the wavelet coef¬ 
ficients in the general cases involving the parent and daughter wavelets. 

8.3.1. Extension to the Real Axis. We will enlarge the Haar system by 
including functions of the form 0 (2 H). Then the sequence {<j)(t — n)}, defined on 
the dyadic intervals I 3 ^ = [k 2-0 (k + 1) 2- 7 ) of length 2 J , where a larger value of j 
means longer intervals I 3 ^ and the corresponding wavelet functions represent 

longer ‘waves’, is not a complete orthogonal system in L 2 (R ), since the closed linear 
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system Vo contains piecewise constant functions with jump discontinuities at the 
integer points. Then a basis for Vo is {<j)(t — k)}. Similarly, the space V\ consists 
of piecewise constant functions with compact support with discontinuities at the the 
rational points which are midway between the integers, and V 2 similar functions with 
compact support and discontinuities at rational points with denominators 2~ 2 . In 
general, the space V n contains piecewise constant functions with compact support 
and disconinuities at the rational points of the form m x 2~ n for any integer m. For 
negative n the discontinuities become far removed from each other. Thus, a basis 
for V n is {ct> (2 n t — k)}. The norm of a function / e V n is ||/|| = (/, f) 1 ^ = 

(f-oo [/W] 2 dt ) 7 < °°- 

The scaling function (j>(t) = X[o,i/2) (£) cannot have a convergent expansion 
of the form (8.1.1). We will enlarge this system by including more functions of 
the form (j) (2 H). Then the sequence {(t>jk(t)} = {2 J//2 0 (2 J t — k) } becomes an 
orthonormal system with its closed linear span Vj . The system {4>jk} is also complete 
in L /2 (-R), but since <j)(t) and 4>(2t) are not orthogonal, it is not an orthogonal system. 
But if we set = (j)(2t) — (j)(2t — 1), then — k)} becomes an orthogonal 
system, and — k) and ijj(t — n ) are orthogonal for all k and n. Thus, the system 
{^jk(t)}^ wher G'ipjkit) = 2i/ 2 'il) 3 2 t — k), is a complete orthonormal system in L 2 (R). 
The amplitude of is chosen such that ||'0j,fc(^)ll 2 = 0 — 1 

for all j and k. Thus, the functions f° rm an orthonormal basis of the space 

L 2 (R) (also known as the Haar basis), such that (^j,k^j,m) = 0 for k ^ m and 
(^j,k^i,m) = 0 for j ^ l and all k and m. A constructive proof of this result is 
available in Blatter (1998, pp. 22-25), which can be summarized as follows. Define 
a signal / E L 2 such that f(t) = 0 for \t\ > 2 m , m > 0, and / is a step function 
which is constant on the intervals I- n ,k of length 2 -n , n > 0. Then a sequence of 
wavelet polynomials {T r r }, r > — n, is constructed from the wavelet functions ijj 3 k 
by 

r 

^r= (8.3.19) 

j = — n+1 k 

such that / = Tv + / r , where f r is the remainder after the r terms, and f r is constant 
on each interval In this construction we start with Tw n = 0, /_ n = /, and 
using recursion on r (r —> r + 1), we define 

fir',k = 2 [fr,2k fr,2k+l] ? fr',k = 2 [fr,2k T fr,2k+l] • 

Let 

c r',k = 2 ^ 3r',ki ^ r ' = ^ r + C r ' t k ^r' ,k ? fr'{t) = fr',ki t^I r ',k‘ 

k 

(8.3.20) 
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In the recursion we begin with r = —n. Then after n + m steps we get 

m 

f = ^m + fm= 53 + fm- (8.3.21) 

j=—n+1 k 

The remainder f m in (8.3.21) is constant on the intervals I m ^ of length 2 m , and 
fm- 1 0 and / m> o ^ 0, where / m _i is the value of / on [-2 m , 0) and / m>0 is the 
value of / on [0, 2 m ). After additional p steps we obtain 

m-\-p 

fm = ^ ^ ^ ^ c j,fc /m+p? 

j=m+l k 

where the function f m +p is constant on the interval [—2 m+p , 0) U (0, 2 m+p ] and zero 
outside it. Since / = 0 outside the interval [— 2 m , 2 m ), we get 

fm+p-1 = 2 P fm- 1, /m+p,0 = 2 P f m ,0- 


Thus, 


/ oo 

|/ ro+p (t)| 2 di = 2™+? 2 _2p |/ m ,_!| 2 + 2-^|/ m ,o| 

-oo L 


which implies that 


||/m +P || = 2 (m “ p)/2 ^|/ TO) -i| 2 + |/ m ,o| 2 . (8-3.22) 

Hence, \\f - ^ m-\-p || = ||/m+pll < C 2-P/ 2 - 0 as p —» oo, where C > 0 is a 
constant. This not only completes the proof but also provides an algorithm (in fact a 
fast algorithm) for computation of the coefficients Cj^ which are defined in (8.3.20). 
The function / is determined by 2 m+n+1 individual function evaluations, and the 
coefficients Cj^ require 2 n evaluations, where this number increases with n. 

This analysis implies that the expansion of a function / £ L, 2 (R) is 


f(t)= 53 53 (8.3.23) 

j = — oo k= — oo 

which is convergent in the sense of L 2 (R). The standard approximation is given by 
the series 

j — 1 oo 

fj( t ) = 53 (f,1pnk)'<Pnk(t), (8.3.24) 

n= — OO k= — OQ 
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which converges to a piecewise constant function with jumps at 2 J k. Thus, fj E Vj, 
and since by Parseval’s equality 


j —1 oo 

(«/ = ^ ^ ] (/j^m) {^jnnrn ^jk) = (/5 5 

n=—00 m=— 00 


(8.3.25) 


we find that /j is a projection of f on Vj, i.e., / = (f,4>jk) 4>jk- This gives a 

k 

uniform pointwise convergence of /j —> /. Note that the uniform convergence of /j 
to / is not provided by the trigonometric system. 

8.3.2. Wavelet Transform. In general, the wavelet transform of a time 
signal f(t) is defined by 

1 roo 1 — 7 

Wf{a,b) = (f,ip a b) = yiTa J f (t) x l > * — J dt, (8.3.26) 

where the double index a, b runs through the set R+ x R ; the variable a is called the 
scaling parameter and b the translation parameter; the factor l/|a| 1//2 is for normal¬ 
ization so that W'lpabW = 1- For the wavelet transform there is an inversion formula 
which represents the original signal / as a ‘linear combination’ of the basis functions 
'ipab, where the values Wf (a, b) of the wavelet transform become the coefficients. 
The characteristic volume element of the index set R+ x R is defined by 

/(*) = [ Wf(a, b) i> ab ^. (8.3.27) 

W JR+xR \ a \ 


The WFT of the Haar father wavelet is given by 


T>(cj) 


e sin(o;/2) 
\^2tt w/2 


and that of the mother wavelet ^(t) by 


(8.3.28) 


tf(w) = 



[ sin 2 (o;/4) g _ W2 

V2n w/4 


(8.3.29) 


The graph of |4/(a;)| is given in Fig. 8.3.5 (see page 543). The function |4/(a;)| has 
its first maximum at the frequency uo ~ 4.6622, and it decays like l/uo as u —> oo, 
but very slowly at infinity because of the discontinuity of ^(t). 

Consider a ‘mother’ wavelet ^(t) which is an infinitely differentiable, rapidly 
decaying function of t defined on R n , with the Fourier transform 4/ (a;) which satisfies 
the following four conditions 

(i) 4/(a;) = 1 if 1 T a < |o;| <2 — 2a, where 0 < a < 1/3, 
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(ii) 4/(a;) = 0 if |a;| < 1 — a or |a;| > 2 + 2a, 

(iii) 4/ (a;) is infinitely differentiable on R n , and 

o° 

(iv) 1^ | 2 = 1 for all co ^ 0. 

j=~o o 

Note that the condition (iv) is satisfied by all orthonormal wavelet bases of the form 

2 -?'/ 2 ' 0(2 H-k). 

If we set fjj (t) = 2(2 k t) and replace the dyadic blocks (8.2.9) by the convo¬ 
lution products A jf m f * ipj, then the Littlewood-Paley-Stein function (see Stein 
and Weiss 1971) is defined by 


g(t) 


oo 


E wm\ 2 - 


(8.3.30) 


If / G 1/2 (R n ), so does g, and ||/||2 = IMI 2 , which implies conservation of energy. 
Also, if 1 < p < 00 , then for all / e L p (R n ) 


Cp WsWp — \\f\\p — Cp \\g\\p. 


(8.3.31) 


where ||/|| p = ^ j Rn \ f(t)\ p dx^j . The inequalities (8.3.31) do not hold for a = 0. 

8.3.3. Ordered Fast Haar Wavelet Transform. The fast Haar wavelet 
transform is used to analyze a signal f(t) in terms of the wavelets in the Haar family. 
This process begins by initialization of an array of 2 n = N entries and then goes 
through n iterations of the basis transform. For each index m, m = 1,, 2,... ? n, this 
array consists of 2 n-m+1 coefficients of 2 n-m+1 step functions defined 

by (8.3.4). After m iterations the array will contain 2 n_m coefficients (denoted by 
a (n-m )) t j ie fusions and 2 n_m coefficients (denoted by of the 

wavelets which are defined by (8.3.5). The step-by-step process is as follows. 

Initialization. Given a sample (data) s = {so, si, • • •, Sj ,... ? S2™-i}> we 
establish a one-to-one relation between s and an array 


* (n) = 


(n) 


a (n) 1 
■ , U>2 n -1 J? 


where the superscript (n) indicates that each array has 2 n elements ranging from 0 to 
2 n — 1. The array corresponds to the approximation / o fa signal f, which is defined 

by 

2 " -1 

m= E«$ n) ^ n) (4- (8-3.32) 

3-0 

First Iteration. This iteration of the basic transform applied to all consecu¬ 
tive pairs { 52 /c, S 2 k+i} of the initial array of the sample s is such that a( n ) = s. 
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m-TH Iteration . In the general case of the m-th iteration, the transform begins 
with the array 


(n— ra+1) (n— m+1) 


(8.3.33) 


which contains 2" m+1 values. The basic transform is then applied to each pair 
| a 2 fe m+1 \ AT" 1 ' }■ which yields two new 2 n_TO pairs of coefficients 



(n—m+1) 

(n—m) 

a 2k 

'2 k 


(n—m) 

(n—m+1) 
_ a 2k 


(8.3.34) 


which can be arranged into the following two arrays: 


(n—m) 

(n-m) 

(n-m) 

(n—m 

'0 ’ 

a l ? • ■ 

.., a 2n _ m _ 

(n-m) 
*0 ’ 

^(n-m) 

^(n-m) 

An-m) 

• • 7 '^2, n ~ rn _ 


, > (8.3.35) 

Thus, at the m-th iteration we obtain the following arrays: 

(i) The beginning array a ( n-m+1 ), defined by (8.3.33), which approximates the 
function / with 2 n-m+1 steps of narrower width 2 - ( n-m+1 ) : 


p(n—m+1) 


(4= E 




(8.3.36) 


(ii) The final arrays a^ n and b^ n , defined by (8.3.35), of which the former 

approximates / with 2 n_m steps of wider width 2 m_n : 


2^-m_^ 

/<"-"*)(*)= ^ ay- m > (8.3.37) 

1=0 

and the latter approximates / with 2 n_m wavelets of wider width 2 m_n : 

f( n ~ m \t) = y' (8.3.38) 


(n—m) i(n—r 

a ) <t>. 




Since the scaling function <f> does not alter the sampled function but only represents it 
with different wavelets, the initial approximation f (”-‘ m + 1 ) If) is the sum of (8.3.37) 
and (8.3.38), i.e., 


f(n-m+ l)( t ) = + j(n-m) 
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Example 8.3.4. Consider the sample s = {5, 1,0,6, 7, 3, 8,4}, where n = 3. 
Initialization. a (3) = s = {5,1,0,6,7,3,8,4}. 


First Iteration. 


a< 2 > = { 
b< 2 ) = { 


5 + 1 0 + 6 7 + 3 8 + 4 

2 ’ 2 ’ 2 ’ 2 

5 - 1 0 - 6 7- 3 8 -4 

2 ’ 2 ’ 2 ’ 2 


} = (3,3,5,6}, 

} ={2,-3,2,2}, 


which is stored as 


s (2) = |a (2) ; b (2) | = {3, 3, 5,6; 2,-3, 2,2}. 
Second Iteration. a (1) = j 3 + 3 , 5 + 6 j = |3, ^ j, 


which is stored as 


S (1) = {a (1) ; P 2 >; P 1 )} = { 3 , ^;0, —1;2,-3,2,2}. 


Third Iteration. a (0) = j -— j = |x}’ 

b ,0, = |i-U/2j = { _ t} 

which is stored as 

s (0) = {a<°>; b(°); b«; b< 2 )} = {f;-f; 0, -I; 2, -3, 2, 2}. 


Thus, the approximation /, given by the initial data s, is 

f(t) = 5 0[o,l/8)(£) + V^l/8,1/4) (t') + 6'0[3/8 j i/ 2)(O + 7 '0[l/2,5/8) (t) 

+ 3 ^[5/8, 3/4) (0 + 8 '0[3/4, 7/8) W + 4 ^[7/8, 1) (0 ? 

and by the final array s^ 0 ) is 

/ (t) = X 0[O,1) (*) - I ^[0,1) (*) + 0 < 0[O,l/2) (*) - 5 ^[1/2,1) (*) 

+ 2 '0[O,l/4) (t) — 3 '0[l/4,l/2) (0 + 2 '0[i/2,3/4) (^) + 2 ^[3/4,1) (0* 

(8.3.39) 

Note that in the representation (8.3.39), the first term 47 <^ 0j i)(£) implies that the 
data s has an average value of 47; the second term — |'0[o,i)(^) means that the 
data undergoes a jump in the opposite direction by | times the size of the mother 
wavelet; the next two terms show an average jump of — \ in the first generation of 
daughter wavelets; and the last four terms show that the sample oscillates with jumps 
of 2, —3, 2, 2 in the second generation of the daughter wavelets. ■ 
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8.4. Other Wavelet Systems 

The Haar wavelet family is the simplest case of wavelets. There are many other 
wavelet families, where each family is generated by a scaling function (father wavelet) 
0. Some important families are discussed below. 

8.4.1. Schauder System. If the Haar functions ^>(t) are replaced by their 
primitives, we obtain the Schauder basis as defined in Meyer (1993). Define 

' 0 t<£ [0,1], 

A (t) = 2t 0 < t < 1/2, (8.4.1) 

^ 2(1 -t) 1/2 <t< 1, 

and consider the sequence {A n (t)}, n > 1, defined for n = 2 J + k by 

A n (t) = A(2 j t-k) j> 0, 0<k<2 j . (8.4.2) 

The functions A n (t) are defined on the interval Ij^ = [k 2 J , (k + 1) 2 J_1 ]. Note 
that A n (t) is the primitive of multiplied by 2 J / 2+1 , and has zeros outside 

[0,1]. If we take Ao (t) = t, then the sequence 

{1, A 0 (t), A a (i), .... A„(t)} 

is known as the Schauder basis of / E L 2 . Thus, every signal / E [0,1] can be 
written as 

oo 

/ ( t ) = a + b t + (S-4-3) 

n =1 

This series converges uniformly everywhere on [0,1], and therefore the coefficients 
ot n are uniquely determined as follows: Since /(0) = a, /(1) = a + 6, which gives 
b = /(l) — /(0). Then consider the function f(t) = a —bt, which has zeros at 0 and 
1. This gives ql\ = /(1/2), = /2(l/4), as = /(3/4), and so on, and in general, 

a n — / ((& + 1/2) 2 J ) — ^ [/ (fc 2 J ) + / ((fc + 1)2 J )] , 

and |a n | < C • Q<rj<l. 

The Haar system is not a Schauder basis of the Banach space X since a Schauder 
basis of X must contain vectors of but the functions V+fcW are not continuous. 

8.4.2. Shannon System. The Shannon scaling function is <$>{£) = s ^ n ^ 7r ^ ^ 

irt 

with its Fourier transform as 

= X[-7T,7r](^)- (8.4.4) 
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For the graph of <j>(t) see Fig. 8.4.1 (see page 543). If the transform F(uo) is such that 
fZ \F(uo)\ 2 duo < oo for every uo, \uo\ > uoo > 0, then from (8.4.4) we obtain the 
expansion formula, known as the Shannon sampling theorem: 

m-±m±$yg. ( 8 .4.5) 

This theorem shows that if the signal / consists of only frequencies that do not exceed 
an upper limit uoq , then a sample of that signal at intervals of tt/uoo is sufficient to 
reconstruct the signal. However, in practical applications we use only a finite number 
of sample points. 

The Shannon sampling theorem also enables us to recover a band-limited function 
f E Vo from its values. On changing the scale in (8.4.5) by a factor of 2, we obtain 
a sampling theorem on the half-integers. The space with this new scale is V\ and it 
contains a function whose Fourier transforms vanish outside the interval [—27r, 2tt\. 
Continuing this process we increase the sequence of spaces. Instead of shrinking we 
can stretch the scale to obtain a sequence 

Toward the left of this sequence the support of the Fourier transform shrinks to zero; 
toward the right it expands to all R. Thus, 

(i) nv m = { 0 }; 

m 

(ii) each / £ L 2 (R) can be approximated by a function in Vm for sufficiently large 


The sequence {V n } is called a multiresolution analysis associated with In 
the particular case when f E Vo, which is composed of i r band limited functions, we 
can write (8.4.5) as 

oo 

f(t) = w - n )- 

n=—oo 


A mother wavelet is given by 


W) = 


sin7r (t — 1/2) — sin27r (t — 1/2) 
7 t (t — 1/2) 


(8.4.6) 


the graph of which is given in Fig. 8.4.2 (see page 544). In the general case, a function 
%jj whose Fourier transform satisfies 


4/(a;) = e luj / 2 xi( ^), where I = [—27r, —7r) U (tt, 2tt], 

is called a Shannon wavelet. Since the Fourier transform of 'ipjkit) is 
Hi’jkit)} = 2-i> 2 V (2j w) e- 2_3 Y 


(8.4.7) 


(8.4.8) 
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and since 

=(^=° (849) 
l 6 k m for j = Z, 

we conclude that 0 is an orthonormal wavelet for L, 2 (R). To show that this system 
is also a basis, we use (8.1.3) and a change of variables to obtain 


eeit ^)! 2 


EEUI/^h** ( 2 'E) 


_z2 3 kuj 


duo 


(8.4.10) 


{ e ikuj . 

_ > is an orthonormal basis of L, 2 (R), which is equivalent to the orthog- 

v27t J 

onality on [0, 2i r], we get from (8.4.10) 


EEIV^)l 2 = E^l/ F ( 2 M 


' do; 




uo)r duo = 


V2n 


\\FH\l = 11 /( 4111 , 


(8.4.11) 


where (2 _J ta) = 1 for w G a.e. Thus, VV) is an orthonormal wavelet for 

3 

L 2 (R). Another Shannon wavelet is 

w = - 2 ,in(2 ;AT 0 ( 8 . 4 . 12 ) 

A graph of this wavelet is given in Fig. 8.4.3 (see page 544). 

8.4.3. Franklin System. The Franklin system (Franklin 1928) defined 
below produces an orthonormal basis from the Schauder basis by using the Gram- 
Schmidt process, as follows. Start with a sequence with f-i(t) = 1, fo(t) = 

2\/3 (t — 1/2),..., such that f* f n (t) dt = f* t f n (t) dt = 0 for all n > 1. This 
sequence is an orthonormal basis for L 2 [0,1] and is known as the Franklin system. 
It has advantages over the Haar and Schauder bases, but its drawback is that it has 
no simple algorithmic structure. Ciesielski (see Meyer 1993) proved that there exist 
constants 7 > 0 and C > 0 such that 


|/n( 4 l <C2 j / 2 e -^ 23t ~ k l t € [ 0 , 1 ], n = 2 j +k, 0<k<2 j , 

(8.4.13) 




< C2 3j / 2 g-7|2 3 t-fc|_ 


(8.4.14) 
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Thus, f n (t ) = 2 J//2 Vis' (2 H — k ), where V’s (2 H — k ) is the Stromberg function 
which satisfies the Lipschitz condition on [0,1,] (Stromberg 1981) and has the 
following properties: (a) ^s(t) £ C(R 1 ); (b) ^s(t) is linear on the intervals 
[1, 2], [2, 3],... , [Z, Z + 1],..., and on [±, 1], [0,1], [-1,0],... , [-(l + l)/2, -1/2]; 

(c) | ^s(t)\ < C (2 — \/3 )^- This implies that 'ipsit) decays rapidly at infinity; and 

(d) 2 J / 2 Vis (2 H — k) is an orthonormal basis for L 2 (R) since2 —\/3 < 1. Stromberg 
has given an asymptotic estimate for f n (t) as 

f n (t ) = 2 J//2 Vis (2 H — k) + r n (t) for n = 2 J + k, 0 < k < 2 J , (8.4.15) 

where ||r n (t)||2 < C( 2 — V3) d ( n \ d(n) = inf {/c, 2 J — &}, and (7 > 0 is a constant. 

8.4.4. Stromberg’s System. Let Ti l (R) denote the real Hardy space 
H 1 (R), which contains real-valued functions u(t) such that u(t) +iv(t) G H 1 (R). 
This means that u G TL 1 (R) iff u and its Hilbert transform u belong to L 1 (R). There 
are two approaches of ‘atomic decomposition’ (or wavelet analysis) of functions in 
H\R): 

I. A function / £ Ti l (R) can be written as (Coifman and Weiss 1977a) 


f(t) = L] A fe A k (t), (8.4.16) 

k =0 

where A/c are such that an d Ak(t) denote the ‘atoms’ of Ti l (R)\ 

i.e., for each Ak(t) there exists an interval R such that \Ak(t)\ < \Ik \~ 1 inside the 
interval R, and ARt) = 0 outside R , where \R \ denotes the length of the interval 
R , and J 7 ARt) dt = 0. These conditions imply that the norms of Ak in H 1 (R) are 
bounded by a fixed constant Co . 

II. Let {Bk(t)} denote a sequence of functions in H 1 , which are linearly inde¬ 
pendent, so that we can write 


f(t) = L] Pk B k(t), (8.4.17) 

k =0 

where the coefficients R are scalars, defined by R = / f(t) gk(t) dt , gRt) being 
the functions in the dual of Ti l . Thus, there exists a constant C > 0 such that if 
\f3k\ < | A k | for all k, then in the norm of the function space H 1 


PkB k (t) <C k B k (t) 


k =0 


k =0 


(8.4.18) 


It is known that the Franklin system /o ( t ), /1 (t ),... , f n (t), without the function 
1, is an unconditional basis for the subspace of 7 ^(R). Stromberg has proved that 
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the orthonormal basis defined by the function ^s(t) is an unconditional basis for the 
subspace of 7 -^(R). 

8.4.5. Lusin’s System. Let H P (R ), 1 < p < oo, denote the Hardy space, 
and let D denote the upper half-plane 9{z} = y> 0. Then a function f(z) belongs 
to H P (R) if it is regular in D and if 

/ /‘OO \ 1 /p 

sup ( / \f(x + i y)\ p dx ) < oo. (8.4.19) 

y> o V J —oo / 


and f(z ) converges to f(x) as > 0, where convergence is in the sense of L p -norm. 
Hardy spaces are very useful in the study of signal processing. Thus, given a real 
signal f(t) of finite energy, — oo < t < oo, we can associate an analytic function 
F(t) whose real part is f(t). Since the energy of / is \f(t)\ 2 dt < oo, we 
require that F(t) should also have finite energy. This means that F belongs to the 
Hardy space H 2 (R). Then F(t) = f(t ) + i g(t ) is the Hilbert transform of f(t)\ for 
analytic signals, see Papoulis (1988). 

The analysis of functions in H P (R) is carried out by using ‘atoms’ (or basis ele¬ 
ments) which are elementary functions in H P (R). One such function is (z — w*)~ 2 , 
where w* denotes the complex conjugate of w <E D. Then a function / £ H P (R) is 
represented by 

f(z) = / (z — w*)~ 2 a(w) dudv, w = u-\-iv , (8.4.20) 

Jd 

where a(w) denotes the coefficients which are simple to calculate. 

The synthesis of functions in H P (R) is obtained by the following rule: Start with 
an arbitrary measurable function a(w) subject to the Lusin’s condition which states 
that the quadratic functional A(x), known as Lusin’s area function, must be such that 


/ [A(x)] p dx < oo, and A(x) = a // \a(u + i v)\ 2 v~ 2 dudv , 
-oo y J Jr(x) 

where T(x) = {(^, v) £ R 2 : v > \u — x\}. Then 

f(z) = JJ (z — w*)~ 2 a(w) dudv £ H P (R), 


(8.4.21) 


and 

a oo l/p 

[A(x)] p dx) , 1 < p < oo, 

-OO ' 

where ||/|| p is the norm of / defined by (8.4.19). But this estimate is sometimes very 
crude; for example, for f(z) = (z + i)~ 2 the value of ff D (z — w*)~ 2 a(w) dudv 


2005 by Chapman & Hall/CRC Press 



8.4. OTHER WAVELET SYSTEMS 


417 


is not unique if we choose the Dirac measure at the point i for a(w). For a unique 

2 i 

decomposition we choose a(w) only as a(w) = — vf'(u-\-iv). Then the two norms 

7T 

||/||p and \\A\\ P are the same for 1 < p < oo. 

8.4.6. Grossmann and Mortel’s System. Grossmann and Mortel (1984) 
define wavelets generated from the above analyzing wavelets ^(t) as 

= ci>0,beR n . (8.4.22) 

These wavelets make an orthonormal basis and are very useful in the analysis and 
synthesis of an arbitrary function / £ L 2 (i? n ). The wavelet coefficients are defined 
by 

W(a,b) = (8.4.23) 

The analysis of the function / is carried out by (8.4.23); its synthesis is given by 

pOO p 7 

f(t)= / / W (a, b) V’o.fe db —Aj- • (8.4.24) 

Jo Jr”■ a 


Example 8.4.1. In the Hardy space H P (R ), 1 < p < oo, the analyzing 
wavelet is ^(t) = — (t + i)~ 2 , which is regular in D. Its Fourier transform is 


T^(cj) = 


— 2,00 e~ u 

0 


for (jo > 0, 
for uo < 0. 


The condition (w.24) yields 


L 


oo 


IRMI 2 f 



- 2 tuj e~ tu 


2 dt 
t 


1 if co; > 0, 
0 if a; < 0. 


Thus, the Calderon’s condition is not satisfied. The wavelets ^ a ,b{t) generate H 2 (R) 
instead of L 2 (i?) when a > 0 and b £ R, and the wavelet coefficients of the function 
/ £ H 2 (R) are 


i r c 

W(a,b) = (f^ aib ) = - / 

^ J —c 


no 


a^fa 


(t — b — ia ) 2 


dt = 2 i ay/af , {b + i a), 


since / is regular in D. ■ 

Example 8.4.2. Consider t/j(t) = l/(£ + z), which belongs to all Hardy spaces. 
Since its Fourier transform is 4*(a;) = i V2 tt e~ u , we find that J 0 °° \^(too)\ 2 — = 
Too if u > 0. Hence, this ^(t) cannot be used as an analyzing wavelet. ■ 

8.4.7. Hat Wavelet System. The hat wavelet scaling function is defined 
by (see Aboufadel and Schlicker 1999) 


4>{t) = < 


t, o < t < l, 

2 -t, 1 <t < 2, 


0, elsewhere, 


(8.4.25) 
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For a graph of this function see Fig. 8.4.4 (see page 544). This scaling function is not 
orthogonal to all of its translates. There exist integers k such that (</>(£),</>(£ — &)) 4 0. 


8.4.8. Quadratic Battle-Lemarie System. The scaling function is de¬ 
fined by (see Aboufadel and Schlicker 1999) 


4>(t) = < 


\t 2 , o<t< 1, 

— t 2 + 3t — 2 <t < 3, 

\{t- 3 ) 2 , 1 < i < 2 , 


< 0 , elsewhere, 


(8.4.26) 


For a graph of this function see Fig. 8.4.5 (see page 545). Like the hat wavelet, this 
scaling function is also not orthogonal to all of its translates. 


8.4.9. Mexican Hat Wavelet System. The Mexican hat (or Maar) func¬ 
tion is defined by the second derivative of the Gaussian / 2 with the normal¬ 
ization such that its Z/ 2 -norm is ||' 0 (t )||2 = 1 , i.e., 

W) = 4= tt“ 1/4 (1 - 1 2 ) e-* 2 / 2 . (8.4.27) 

v 3 

Its Fourier transform is 

(w) = 4= 7T- 1 / 4 ca 2 e^ 2 / 2 . (8.4.28) 

v3 

The Mexican hat function ^(t) is such that f^° r ip(t) dt = 0, and 

/ oo 

|4/(a;)| 2 |cj| _1 duo = | 7r -1 / 4 < oo. (8.4.29) 

-oo 

For a graph of this function see Fig. 8.4.6 (see page 545). This wavelet is discussed in 
Foufoula-Georgion and Kumar (1994). This family has no simple scaling function, 
and in this respect it is different from other wavelet systems. 


8.4.10. Meyer System. The Meyer wavelets are 

ijj a ' x (t) = |a| -1//2 4^-—for a,x e R, a 4 0. 
Then < ||/||. For any f,g e L 2 (i^) we have 

/ oo /-oo r /-oo 

/ / [$(aw)f dw 

-oo J — oo L J — oo 
■ /»00 

x / [G(w)]*|a| 1/2 e W [^(aw')] ^ 

_ J — OO 

/ OO 7 

n»fcof(^) [G'(w)]* |*K>)| 2 d W 

-oo l a l 


(8.4.30) 


da db 


= 27r 


= f Vtt < (/,#), 
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which yields 


n °° fin rlh 

(f,V’ x ){ g ,V’ x )*^r = IV^ < (f,g). (8.4.31) 

a 


8.4.11. Wavelet Analysis and Synthesis. For wavelet analysis, we 
consider the L p space. Some observations are noted here. 

(a) For the space L p [ 0, 2i r], 1 < p < oo, the functions cos kt and sin kt cannot 
be the ‘atoms’, because these functions do not provide simple and useful assembly 
rules. 

(b) The simplest atomic decomposition (or wavelet analysis) for the spaces L p [ 0,1], 
1 <p< oo, is provided by the Haar system. The Franklin system also gives a simple 
atomic decomposition. 

(c) From the point of view of wavelet theory the Franklin system and the Littlewood- 
Paley analysis are related. 

(d) For a simple approach to ‘atomic decomposition’ we can use Calderon’s 
identity which is as follows: Let ' ijj ( x ) E L2 ( R n ) be the so-called analyzing wavelet 
(by Grossman and Morlet, see §8.1.8). Its Fourier transform 4*(a;) is subject to the 
condition 

\^(tu;)\ 2 ^ = 1 for almost all u e R n . (8.4.32) 

If V’ G L\ (_R n ), this condition becomes 


/ ijj(x)dx = 0. (8.4.33) 

J R n 

Write fa(x) = fa)(—x))*, fa(x) = t~ nf ip(x/t ), and Tl(t) = t~ n ^(x/t). Let Q t 

denote the operator defined as convolution with fa, and let its adjoint operator be 
denoted by Q *. The Calderon’s identity is a decomposition of the identity operator 
defined by 

dt 

1 = j o QtQtj. (8.4.34) 

The first synthesis is to relate the Littlewood-Paley decomposition (1930), Franklin 
system revised by Stromberg, and the Calderon’s identity. This synthesis is based 
on the definition of the wors ‘wavelet’ and the related wavelet transform. There are 
three basic definitions: 

First Definition. (Grossmann-Morlet, §8.4.8) A wavelet is a function ^ e 
L 2 (R) whose Fourier transform 4 /(cj) satisfies the condition (8.4.32). 


2005 by Chapman & Hall/CRC Press 



420 


8. WAVELETS 


Second Definition. (Littlewood-Paley-Stein, §8.3.2) A wavelet is a function 

o° 

^ £ 1 / 2 (R n ) whose Fourier transform T(cj) is such that Y 1^ | 2 = 1 

j = -oo 

almost everywhere. 

Third Definition. (Franklin-Stromberg, §8.4.3 and §8.4.4) A wavelet is a 
function ip £ L2(R) such that 2 ( 2 H — k) is an orthonormal basis for L2{R). 

In going from the first to the third definition we have increased the number of 
conditions, thereby narrowing the scope of wavelets. The wavelet analysis of func¬ 
tions does the same thing: In Grossmann-Morlet’s definition the wavelet analysis 
of a function ^ yields a function W (a, b) of n + 1 variables a > 0 and b £ R n , 
where the function W (a, b) is defined by (4.8.23). In Littlewood-Paley, a is replaced 
by 2 _J , and b is denoted by t. Thus, if G denotes the multiplicative group { 2 _J }, 
then Lettlewood-Paley analysis is obtained by carrying out the Grossmann-Morlet’s 
analysis on G x R n . In Franklin-Stromberg analysis a is replaced by 2 -J and b by 
ka~R 

In these three cases the wavelet synthesis deals with the reconstruction of f(t ) 
from its wavelet transform. In Grossmann-Morlet wavelets this synthesis is given by 

(4.8.24). In Littlewood-Paley case the integral J 0 °° u(a) — is replaced by the sum 

o° 

Y u ( 2 _J ), and the synthesis (4.8.24) becomes 

j = ~o o 


m 


oo „ 

T / ( A V) -b)db. 

_ J R n 


j = -oo 


(8.4.35) 


For the Stromberg’s orthogonal wavelets the integral in (8.4.35) reduces to a sum in 
the case n = 1 and the synthesis is then given by 


oo oo 

/(*) = T T a C fe )£,fc(T (8.4.36) 

j = — oo k= — oo 


8.5. Daubechies’ System 

The orthonormal bases of the form 2 (2R — /c), where ^ £ C 1 with compact 
support, were discovered by Daubechies (1988). For each integer r there exists an 
orthonormal basis of L 2 (R) of the form 2 J//2 Vv ( 2 H — k ), such that (i) the support 
of Tp r is the interval [ 0 , 2 r + 1 ]; (ii) 0 = ^r(r)dt = • • • = t rr ijj r (r) dt; 
and (iii) ^ r (t) has 7 r continous derivatives, where 7 « 1/5. For r = 0 this system 
reduces to the Haar system. 
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The Daubechies wavelets are more effective in both analysis and synthesis than 
the Haar system. For example, if the function / being analyzed has m continous 
derivatives, 0 < m < r + 1 , then the coefficients a(j, k) from its decomposition 
in the Daubechies basis are of the order of magnitudes whereas it is of 

order 2 _3j//2 in the Haar system (m = 1). It means that while computing /(£), the 
coefficients that are retained (i.e., those exceeding the machine precision) are much 
less than those in the Haar system. This process is known as ‘signal compression’. 
Similarly the synthesis obtained by using the Deubeuchies system is far better than 
the Haar system. This system is composed of a wavelet family that has compact 
support and some smoothness. We will discuss the one-dimensional case. The 
Daubechies wavelets satisfy the following requirements: (a) The scaling function 
(j)(t) has compact support (or finite duration of time) and 0 (£) = 0 outside the 
interval [0, 3]. Thus, all refinement coefficients are zeros except co, ci, C2 and C3, 
which implies that 

4>{t) = Co 0(2 1) + ci 0(2 t — 1) + C 2 0(2 t — 2) + C 3 0(2 t — 3). (8.5.1) 

(b) The class of wavelets so constructed is satisfied by the orthogonality condition, 
which requires that the scaling function 0 (£) be orthogonal to its translates {<j)(t — k )}. 

oo oo 

Since by Parseval’s formula c k = 2 and c k Ck- 2 j = 0 for every integer 

k= — oo k =—oo 

j ^ 0 , this class of wavelets satisfies the conditions 

2 i 2 i 2 i 2 o 

C 0 + C X + C 2 + C 3 = 2, 

c 0 c 2 + Cl c 3 = 0, (8.5.2) 

Co C3 — Cl C2 + C2 Cl — C3 Co = 0. 

This condition, known as the regularity condition , demands the smoothness of the 
scaling function 0 (£) so that a smoother scaling function produces a better approxi¬ 
mation for polynomials p(t) and functions (or signals) f(t). Thus, we must be able 
to express all constants, linear polynomials and signals as a linear combination of the 
elements {cj)(t — k)}. 

The Daubechies scaling function 0(£) is constructed recursively by assuming the 
initial values 


0(0) =0, 0(1) = 1±^, 0(2) = 1^, 0(3) = 0, 

such that the function 0(£) satisfies the recurrence relation (8.5.1), where 


(8.5.3) 


co = 


1 + y/3 


ci = 


3 + y/3 


C 2 = 


3-V3 


C3 = 


i - Vs 


(8.5.4) 


are known as the Daubechies coefficients. Note that 0(0)+ 0(1)+ 0(2)+ 0(3) = 1. 
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Example 8.5.1. Using (8.5.1)—(8.5.3) we get 

0(1/2) = c 0 0(1) A Cl 0(0) A c 2 0( l) A C 3 0(—2) 

1 A \/3 1 A y/3 2 A \/3 

~ 4 2 _ 4 ’ 

0(3/2) = Co 0(3) A ci 0(2) A c 2 0(1) A c 3 0(0) 

_3Aa/31-\/3 3-a/31Aa/3_ 

~ 4 2^4 2 — ’ 

0(5/2) = Co 0(5) A ci 0(4) A c 2 0(3) A c 3 0(2) 

_1Av / 31-V / 3_2- V / 3 
_ 2 2 _ 4 ‘ 

For values of t which are odd multiples of 1/4, we use the recursion (8.5.1) and obtain 
the following values: 


t 

1/4 

3/4 

5/4 

7/4 

9/4 

11/4 

4>(t) 

5+3^3 

16 

9+5^3 

16 

1 + V3 

8 

i-Vs 

8 

9-5^3 

16 

5—3 A3 

16 


The associated Daubechies ‘mother’ wavelet 0(t) is defined by the recurrence 
relation 

0(t) = —Co 0(2 1 ) A ci 0(2 1 — 1) — c 2 0(2 1 — 2) A c 3 0(2 1 — 3). (8.5.5) 

Note that 0(t) = 0 if 2t A 2 > 0 or 3 < 2t — 1, i.e., if t < — 1 or 2 < t. Thus, the 
recursion (8.5.5) yields the Daubechies wavelet 0(t) for — 1 < t < 2. For example, 
using (8.5.4)-(8.5.5) we obtain the following values: 


t 

-1 -1/2 

0 1/2 

1 3/2 2 

i>{t) 

0 -1/4 


1/4 0 


The above recursion produces the values of 0(£) and 0(t) only at integral multiples 
of positive or negative powers of 2. These values are sufficient for equally-spaced 
samples from a signal f(t) since the signal remains unknown between the sample 
values. We will use the values that are known as dyadic, which makes a number field 
containuing numbers of the form p A q and follows the same rule for addition 
and multiplication as the complex numbers. 

The graph for the Daubechies wavelet 0(t) can be obtained by using the Matlab 
command: > wave=MakeWavelet(2,-4, f Daubechies 4, Mother* 3072). 
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The Daubechies wavelets satisfy the following conditions: 


Recursion: <j>{t) = ^ c^ 0(2 1 — fc), N = 2 n , 


(8.5.6) 


Wavelet: 0(t) = (—l) fe ci_fc 0(2£ — fc), 

k=l-N 

[N/2] [(N- 1)/2] 

Existence: E °k = 1 = ^ C 2 fe+1, 

fc =0 fc =0 

Orthogonality: / 0(2£ — fc)0(2£ — m) = 0 for k ^ m, 

Jr 


min{ V,V+2m} 


Cfc Ck—2 m — 


fc=max{0,2m} 


2 if m = 0, 
0 if m ^ 0. 


The recursion (8.5.6) can be written for each j = 1,... , TV — 1 as 


(8.5.7) 


(8.5.8) 


(8.5.9) 


(8.5.10) 


E Cfe ^(2j “ U 


which when listed for each j yields a linear system of N — 1 equations 

0(1) = Cl 0(1) + Co 0(2), 

0(2) = c 3 0(1) + c 2 0(2) + Cl 0(3) + c 0 0(4), 


0(iV — 2) = cjv 0(iV — 4) + cat-i 0(iV — 3) + cat-2 0(^2) + ctv-3 
0(1V - 1) = CTV-l 0(JV - 2) + CTV-l 0(JV - 1). 

This system can be written in matrix form as 0 = H 0, where 

0 = [0(1) 0(2) ••• 0(1V — 2) 4>{N — 1) ] T , 

'Cl Co 

C3 C 2 Ci Co 

C5 C4 C3 C2 Ci Cq 


cn cn-i cat- 2 c/v-3 


Cn Cn- 


where the element hij of the matrix H are given by 


c 2i -j if 2i - j = 0,... ,N, 
0 
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Thus, the odd columns of H contain the coefficients with odd indices and the even 
columns those with even indices. Also, in view of the condition (8.5.8), we have 

[n/ 2 ] [(TV— 1 )/ 2 ] 

Y C 2 k = 1 = Y c 2 k+i , which means that each column of the matrix H adds 

k= o k= o 

up to unity. Hence, the vector 1 = [1 1 ... 1 1] T is the eigenvector with 
eigenvalue 1 for the transposed matrix H T , and H T 1 = 1. Since H T and H have 
the same eigenvalue, H will also have the eigenvalue 1 for some eigenvector 0. Thus, 
4>(j) = tj is the value of 0 at an integer j, and by (8.5.6) we can find the values of 0 
at all dyadic points as of the form 0 (fc/ 2 m ) for each positive inter m and all intergers 
k = 0,... , 2 m N. 

Example 8.5.2. For N = 3 (i.e., n = 2) consider the coefficients Co, ci, C 2 , C 3 
defined by (8.5.4). Here, cq + C 2 = 1 = c\ + C 3 ; also, the matrix H is given by 


H 

and has eigenvalues 1 and 
eigenvectors [—1 1 ] T and 


Cl 

Co 

1 

C3 

c l_ 

_ 4 


3 + Vs i + Vs 

1 — \/3 3 — 


1 

2 * 


We may note in passing that the matrix H has the 
1 /3 1 T 

-— 1 . Since 0(0) = 0 = 0(3), we solve 

1 — \/3 -I 

the system (H — I) 0 = 0, where 0 = [ 0 ( 1 ) 0 ( 2 )] T , and find 0 ( 1 ) and 0 ( 2 ) to be 

the same as defined by (8.5.3), so that 0(1) + 0(2) = 1 approximates J R <j)dt = 1 by 
using the repeated midpoint quadrature rule. In fact, for all types of wavelet system 
that satisfy the conditions (8.5.6)-(8.5.10) the sum of the values of 0 at all integers 
is always equal to unity and the integral of 0 is also equal to unity, i.e., 


E^C4 = 1 and 

3 



(8.5.11) 


These results can be proved as follows: 


N 


53 0 (i/ 2m+1 ) 2_(m+1) = E E( 2 07 2ro+1 ) - k ) 2 ~ {m+1) 

j j k=0 


N 


= EE c k 4>{j/2 m -k) 2 (m+1) 

j k=0 


N 


3 2 m fc \ ( m+1 ) 


2 m 


= EE c ^ 

j fc=0 
A 

= E Cfc E^(- 

fc=0 j 

A A 

= 5 E 2 m ) 2— = i X cfe = 1; 


j 2 TO fc \ ( TO+1 ) 


fc=0 j 


fc =0 
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lim y>(i/2 m ) 

771^00 z ' 

3 


lim 1 = 1 . 

ra^oo 


8.5.1. Approximation of Functions. The Daubechies scaling function 
0 (t) and the ‘mother’ wavelet 0 (t) can both be used to approximate a function / 
which represents a signal, but unlike the Haar wavelet which interpolates signals 
at the sample points (data) in discontinuous steps, the Daubechies system yields a 
smoother approximation f of f which is known only from the set of sample points 

S = { 80 , Si, . . . , S2^-2, S2^-l}. (8.5.12) 


For the sake of simplicity we assume that the sample points of a signal / are at integer 
point so that Sk = /(fc). These points are equally spaced if we use the transformation 
g(k) = f(k/m ) so that 8 ^ = Qk = f(k/m). Thus, the Daubechies wavelets start the 
approximation with the sample s and use multiples of shifted basic scaling function 
0 , thus giving 

2 n — l 

f{t)= ^2 a k<t>{t-k). (8.5.13) 

k =-2 


Note that the translations 0(t — k) of 0(t) by integers k < 2 or k > 2 n — 1 are zero 
forO < t < 2 n . 

Example 8.5.3. We choose a set of equally spaced sample points {1/2, 3/2, 5/2, 
and find that 0(1/2) = 0.9330127, 0(3/2) = 0 and 0(5/2) = 0.0669872. This ap¬ 
proximates /(O)0(l/2) « /(0), /(l)0(3/2) = 0, and /(2)0(5/2) « 0. Thus, 
f(t) = /(0), which almost approximates the signal f(t) at the point 1/2, and the 
relative error (which is relative to the values of / with maximum magnitude) in this 
approximation is |1 — 0.9330127| + |0 — 0| + |0 — 0.06698721 « 1.34 x 10 -2 . Let us 

consider three equally spaced points to = -— = ~—= ~— 

Then since 


649 650 

<t o < 


1024 


1024’ 1024 


1673 1674 

<ti < 


1024’ 1024 


2697 2698 

<t 2 < 


1024’ 


we obtain three sets of equally spaced points 


649 1673 2697 q r ^ f 650 1674 2698 q 

1024’1024’1024/’ t* 0 ’* 1 ’* 2 *’ 11024’ 1024’ 1024J' 


If we choose the last set, then 0 (to) = 0.999985, 0 (ti) = —0.000155 and 0 (t 3 ) = 
0.00017. Thus, /(O)0 (to) « /(0), /( 1)0 (ti) « 0, and /(2)0(t 3 ) « 0. Thus, 
f(t) = /(0), and the relative error in this approximation is 11 — 0.999985| + |0 + 
0.000155| + |0 — 0.00017| « 3.4 x 10 -4 . For the first set we obtain a similar result, 
but since 0 (to)) = 1 = 0 (ti) = 0 (t 2 ), the set {to, ti, t 2 } yields the same result as 
that obtained by the set {1/2, 3/2, 5/2}. ■ 
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The simplest case of choosing the coefficients ak in (8.5.13) is to take ak = s^ 
for each k = 0,1,... , 2 n — 1. This leads to the approximation 

2 n —1 

f(t)= ^2 s k Hi - (8.5.14) 

k =0 

which is an interpolation of / at the sample points (data) s^ = f(k). For the sake 
of simplicity we will consider examples in the sequel with n = 2. For values of 
n > 2 the procedures can be extended similarly. Thus, for n = 2 the coefficient 
ao can be expressed as an average of the data s = {so, si, s 2 , s s} weighted by the 
corresponding values of 0 , which gives 

a o — s o 0(0) + si 0(1) + S 2 0(2) + S 3 0(3). (8.5.15) 

In the sequel we will present examples with this data set s. 

Example 8.5.4. Let the sample be s = {s 0 , si, s 2 , s 3 } = {0,1,2,3}. Then, 

o _ /o 

from (8.5.15) and (8.5.1) we find that ao = —-— ~ 0.633974596, and the ap¬ 
proximation / with this data contains ao 0 . ■ 

There are some different methods for computing the initial coefficients a& near 
the edges (start and end) of a given sample, which help alleviate the edge effects in 
computing the approximation f(t) of a signal f(t). We will discuss the following 
three methods in detail (see Blatter 1998, Nievergelt 1999). 

Method 1. The distorted edge effects are alleviated by extending zeros be¬ 
fore and after the sample s. The example given below explains how this method 
works in producing distorted approximations near the edges of a sample. Let s = 
{ 80 , 51 , 82 , 53 } = {/(0),/(l),/(2),/(3)} be extended at both edges so that the 
extended sample becomes 

{s_ 4 , 8_3 8_2 8 _i, So, 81 , S 2 , 83 , S 4 , S 5 , Sg, S 7 }. 

Then each coefficient is computed by a weighted average technique, called a 
convolution of the extended sample weighted by the shifted scaling function, i.e., 
for each (negative, zero and positive) integer k 

77/T 3 

cik = E St ‘’V “ *0- (8.5.16) 

t=n 


Example 8.5.5. (Nievengelt 1999) Consider a sample s = {so, si, s 2 , 83 } = 
{ 0 , 1 , 2 ,3}, and let the extended sample be 

{ S_4 8_3 8_2 S— 1, So 84 S 2 83, S4 S5 Sg S7 } 

={0 0 0 0;0123;000 0 } 
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The coefficient ao has been computed in Example 8.5.4. For k ^ 0, we align the 
values of t, (j)(t — k ) and s t in the following tabular form which helps a visual setup. 
Thus, to compute a\ the sample s is weighted by (j)(t — 1), and we get 


t 

-4 

-3 

-2 

-1 

0 

1 

2 

3 

4 

5 

6 

7 

4>{t - 1 ) 

0 

0 

0 

0 

0 

0 

1 +V 3 

2 

i-Vs 

2 

0 

0 

0 

0 

St 

0 

0 

0 

0 

0 

1 

2 

3 

0 

0 

0 

0 


a(+ i\ o 1 + a/3 1 — \/3 5 — \/3 

ai = 2^ s t <!>{t - 1) = 2 • —-— + 3--— = —-—• 


t =l 


For computing <22 the sample s is weighted by (j)(t — 2) and we get 


t 

-4 

-3 

-2 

-1 

0 

1 

2 

3 

4 

5 

6 

7 

(j>(t - 2) 

0 

0 

0 

0 

0 

0 

0 

1 + V3 

2 

l — y/3 

2 

0 

0 

0 

St 

0 

0 

0 

0 

0 

1 

2 

3 

0 

0 

0 

0 


t =2 

For negative values of k , we use formula (8.5.16). Thus, for computing a_i the 
average of s is weighted by cj)(t + 1), which gives 

, / .. x 1 — \/3 

a_i = 2^ s t + i) = —^—, 

£= — 1 

and for computing a _2 the average of s is weighted by (j)(t + 2), which yields 


i_2 = F! s t^(i + 2) = 0. 


t =-2 


Hence, the approximation of / is given by 

Ht) = ^2 a k <t>(t—k) = w +!)+ 3 <t>(t) 


k =-2 
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Note that at the edges, /(0) = — \ ^ 0 = so, and /(3) = 5 ^ 3 = 53 , but at the 
remaining data /( 1 ) = 1 = s\ and /(2) = 2 = 82 . ■ 

Method 2. The edge effects are alleviated by extending the sample s with 
values similar to those in the sample by reflecting them periodically in the mirrors 
placed at the two ends of the sample. This method will be explained by the following 
example. 

Example 8.5.6. Consider the sample s and extend it by mirror reflection at 
both edges so that the extended sample becomes 

4, <S_3, S — 2, 8_i, 80, 81, 82, 83 , 84, 85, 85, 87 j- 

= {3, 2 ,1 ,0; 0, 1, 2, 3; 3, 2, 1, 0} 

reflection data reflection 

The values of ao, a\ and a 2 turn out to be the same as in Example 8.5.5. We find that 

5 1 

<22 = s t (j){t — 2) = 3, and a _2 = s t (j){t + 2) = 0. 
t =2 t =-2 


Thus, 


2 

f(t) = Y a k <j>(t-k) 

k=-2 

= — (j)(t + 1) H- <f>(t) H- (j)(t - 1) + 3 (j){t - 1). 

Note that at the edges, /(0) = — \ ^ 0 = 80 and /(3) = 7/2^3 = 83, but 
/(l) = l = s 1 and /(2) = 2 = 8 2 . ■ 

Method 3. The edge effects are alleviated by considering smooth periodic 
extensions of the data which are carried out by a mirror reflection at either end. This 
extension can be represented as 

80, 81, ..., 82^-2, <§2^-i; 82^-1, 82^-2, • ••, si, s 0 

'-V-' '-V-' 

data reflection 

For the computation of the last coefficients a& that are associated with the translates 
(j)(t — k) which overlap the right edge, we add a ‘short’ reflection. This leads to the 
extended data structure 

So, s 1, ..., 82^-2, S2™—1; 82^-1, S2™—2, •••, si, 80; 8p,^8i^ 

data reflection short reflection 
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The number of data entries in the ‘short’ reflection depends on the type of wavelets 
used, and is equal to the number of recursion coefficients minus two. In the case of 
Daubechies wavelets with the four recursion coefficients co, c \, C 2 , C 3 , this number is 
2, and we have, therefore, added only two data entries in the ‘short’ reflection. Hence, 
the data structure with periodic smooth extension is 


(8.5.17) 


data 


extension 


short extension 


Note that at the right edge of the data portion of the structure in (8.5.17) the data 
changes by S 2 ™-i — 82^-2 (which is the difference between the last two entries in 
the data), and this change must be equal to the change in the extension portion of the 
structure at the same location, which is 82 ^ — 82^-1 (difference between the first entry 
in the extension and the last entry in the data). Thus, 82 ^ — 82^-1 = 82^-1 — 82 ^- 2 , 
which gives 


S 2 n. — 2 8'2'" —1 — 8'2'" -2- (8.5.18) 

Similarly, at the left edge the data change by 81 — 80 (which is the data change in 
the short extension) must be equal to the change in the extension at the same location 
which is 80 — 8 2 ™+i_ 1 . Thus, 80 — 8 2 ™+i_i = s\ — 80 , which gives 


8 2 ™+i_i — 2 80 — 81. 


(8.5.19) 


Now, we will determine the remaining entries 82 ^+ 1 ,..., 8 2 ™+i _2 of the extension in 
the structure (8.5.17) without introducing extraneous discontinuities. For this purpose 
we use a cubic spline consisting of a cubic polynomial p(t), which has the form (see 

§1.7) 


p(t) =P 0 +Pi(t- (2 n - 1)) + P 2 (t - (2 n - 1)) (t - 2 n ) 

+ Ps(t- (2 n - 1)) (t - 2 n ) ( t - (2 n+1 - 1)) , (8.5.20) 

subject to the following conditions 

p(2 n -l) = s 2 »_ 1> 

p (2 n ) = s 2 « = 2 s 2 n_ 1 - s 2 .._2 by (8.5.18), (8.5.21) 

p (2 n+1 - 1) = s 2 ..+i_i = 2 s 0 - si by (8.5.19), 

P (2 n+1 ) = s 0 . 

The conditions (8.5.21) form the following linear system of algebraic equations in 
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the coefficients po, pi, P 2 , P 3 • 


PO = §2--l, 

Po +Pi (2 n — (2 n — 1)) = 8 2 *i = 2s 2 ™-i — <§2^-2, 

P0+P1 (2 n — (2 n — 1) — (2 n — 1)) 

+ P2 ((2 n+1 - 1) - (2 n - 1)) ((2 n - 1) - 2 n ) = 8 2 *i + i_i =280-8!, 
PO + Pi (2 n+1 - (2 n - 1)) + p 2 (2 n+1 - (2 n - 1)) (2 n+1 - 2 n ) 

+ p 3 (2 n+1 - (2 n - 1)) (2 n+1 - 2 n ) (2 n+1 - (2 n+1 - 1)) = 80, 

which simplifies to the matrix form 


-1 


r po ) 


r <§2--i 

1 1 


\ Pl \ 


| 282*1-1 — 82*1-2 > 

1 2” 2” (2” - 1) 

< 

1 P2 1 

> = < 

1 280 - <§1 

.1 2” 2” (2" — 1) 2” (2" + 1). 


1^3 j 


l <§0 


This system is solved to give 


PO — <§2'"-l, 

Pl = 82^-1 — <82*1-2, 

28 0 - <§1 - <§ 2 --i - 2 n pi 


P 2 = 


2 n (2 n - 1) 


(8.5.22) 


_ 80 — 82*1-1 — (2 n + 1) pi 

Ps ~ 2 n (2 n + 1) P2 ' 


Hence, to determine 82*1+1 ,..., 8 2 *i+i _2 we take Sk = p(fc) for 2 n+1 < k < 2 n+1 — 

2 . 


Example 8.5.7. Using the above sample s, we find from (8.5.18) and (8.5.19) 
that 84 = 4 and 87 = —1, respectively. We will attach the periodic reflection to the 
left edge of the data, so that the extended sample (8.5.17) becomes 

•^8—4, 8_3, 8_2, <§—1, <§0, <§1, <§2, <§3 , <§4, <§5, <§6, <§7, <§0, <§1J 1 

= {4, 2, 1, -1; 0, 1, 2, 3; 4, 2, 1, -1; 0, 1 } 

periodic extension data reflection short ext. 

where the values of 85 and 86 are chosen by using the mirror reflection to 83 as 2 and 
1, respectively. The values of the coefficients ao, a\ and a_i remain the same as in 
Example 8.5.5, and those of <22 and a_2 are computed as follows: 


\ N 1 -f \/3 1 — \/3 

a 2 = ^ s t (j)(t — 2) = 3 • —--b 4 • —-— 

t= 2 

\ N It\/3 

a~ 2 = 22 St ^ + 2) =--—. 

t=- 2 


7- VS 

2 
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Thus, 


f(t) = ^2 a k 4>(t -k) = - 1 + 2 ^ 4>(t + 2) + 1 ^ 4>(t +1) 

k =-2 

3 — \/3 . 5 — \/3 7 — v 7 ! 

H - 0(t) H - (f>(t — 1) H - (f>(t - 2). 

In particular, /(0) = 0 = s 0 , /(l) = 1 = si, /(2) = 2 = s 2 , /(3) = 3 = s 3 , which 
shows that the above wavelet approximation f(t) has practically no edge effects. ■ 


8.6. Fast Daubechies Transforms 

The Daubechies wavelets are computed by fast transforms. We start with a sam¬ 
ple (data) s = {so, si,..., <$ 2 ^- 2 , 5 2 ™-i}, which contains a number of elements 
equal to N = 2 n . If this number is not equal to radix 2, we must first extend 
(or shorten) the sample s smoothly so that it contains 2 n elements. For this pur¬ 
pose we can use any of the three methods discussed in §8.3.3. The coefficients 
= {( Iq ^, a ^,... , } are then used to replace the 2 n basis father wavelets 

defined in (8.5.13) by an equivalent combination of 2 n slower wavelets 0 (t/2 — k) 
and 2 n slower wavelets 0 (t/2 — 1 — k), so that we have 

2 n -l 

im = £ 

k =0 


j ^ 0 (t/2 - k) + b^ 1 ^ 0 (t/2 - 1 - k) j, (8.6.1) 


where the superscript (n — 1) indicates a slower frequency than (n) in the representa¬ 
tion (8.5.13). The translation t/2 —» (t/2 — 1) in the wavelets 0 in the representation 
(8.6.1) ensures that both 0 and 0 are zero outside the same interval. For the compu¬ 
tation of the coefficients and ^ in (8.6.1) we use the recurrence relations 

00) = co 0(20) + ci cj)(2t — 1) + c 2 0(2 1 - 2) + c 3 cj)(2t - 3), 

00) = -c 0 <f>(2t - 1) + ci (j)(2t) - c 2 <f>(2t + 1) + c 3 cj)(2t + 2), (8.6.2) 

where Co, ci, c 2 , c 3 are defined by (8.5.4). If we replace t by t/2 in the recurrence 
relations (8.6.2), we obtain 

(/(t/2) = c 0 00) + Cl (j)(t — 1) + c 2 00 - 2) + c 3 (j)(t - 3), 

00/2) = -c 0 00 — 1) + ci cj)(t) - c 2 cj)(t + 1) + c 3 cj)(t + 2). (8.6.3) 
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This leads to an algorithm for the Daubechies transforms, which uses the recursion 
(8.6.3) and yields the following system linear equations: 


<t>(t/ 2) = c 0 </>(t) + ci <f)(t - 1) + c 2 </>{t - 2) + c 3 <f)(t - 3), 
^{t/2 - 1) = c 3 (/>(t) - c 2 (j)(t - 1) + c\ (j)(t - 2) - c 0 (/)(t - 3), 


cj)(t/ 2 — fc) = Co 4>(t — 2k) + ci cj)(t — 1 — 2k) + C2 4>(t — 2 — 2k) 

+ C3 cj)(t — 3 — 2fc), 

f 4>(t/2 — 1 — k) = C3 <p(t — 2k) — c 2 4>{t — 1 — 2k) + ci (j)(t — 2 — 2k) 

-c 0 (j)(t-3-2k). (8.6.4) 

The matrix D, defined by 



"c 0 

C3 




Cl 

-C 2 




C 2 

Cl 

Co 

C3 

D = 

C3 

-Co 

Cl 

-C 2 




C2 

-c 2 




C3 

-Co 


(8.6.5) 


where all blank elements are zero, is known as the matrix of the change of Daubechies 
basis. The relations (8.5.2) hold for the inner products of the columns of the matrix 
D. Since D T D = 21, we have D 1 = ^ D T , and the system (8.6.4) can be written 
in the matrix form by D T m = d, where 


rn =[(p{t) 4>(t- 1) 4>(t- 2) 4>(t- 3) ...] T , 

d=[<KC 2 ) ^(C 2 ) <KC 2 — !) AC 2 - 2 ) 


Thus, the wavelet transforms are computed by changing from the basis with wavelets 
cj)(t — k) to the basis with the wavelets <j)(t/2 — k) and ^(t/2 — 1 — k). This means 
that we can multiply the coefficients a^ in (8.5.13) by the inverse matrix D -1 . It 
requires that we read the new coefficients in a row of the type 


q = 


{ 


a 


(n—1) 
0 


b 


{n —1 
0 


a 


(n—1) 
1 


6 (n_1) 


.. ,a 


(n—1) 
2™- 1 — 1 ’ 


(n—1 


} 


which are computed in terms of the previously known elements of by the formula 
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q = i D T a^ n ), 


or 


r (n— 1) 7 

[% k 


Co 

C3 


x \a { 


(n) 

0 


(n-l) (n- 

0 a l 

-1) 

b { v ~ 

1) 

Cl C 2 

C3 



-C 2 Ci 

—c 0 



Co 

Cl 

C2 

C3 

C3 

c 2 

Cl 

-c 0 



Co 

Cl 



C3 

c 2 


7 0) 

h 


a, 


O) n ( n ) 

UjO 


(n—1) 
x 2'"-1_ i 


V-i-i. 


(n) 

2 2 «+ 1 _2 


( 8 . 6 . 6 ) 


Co Cl 

C2 

C3 


C3 -C 2 

ci - 

-c 0 - 


(n) 

a 2 n + i-l 

(n) 

<V+i 

V n) ] T 

a 2"+ 1 + l J 


This formula computes the Daubechies wavelet transforms. In this formula the coef¬ 
ficients a^ are those of the wavelets <j)(t /2 — k ) and the coefficients those of the 
wavelets t/j(t/2 — l — k). Formula (8.6.6) is used recursively for the next iterations of 
the coefficients a^ and b^ and continued until the (N — l)-st iteration is computed. 
The details of this method can be found in Daubechies (1988, 1990), and Nievergelt 
(1999). 

Example 8.6.1. For N = 2 2 = 4 (n = 2), let the sample (data) be s = 
{0,1,2,3}. 

Step 1. A periodic extension of this data gives 


0, 1, 2, 3 ; 4, 2, 1, -1 ; 0^1 

data extension short extension 

(see Example 8.5.7). 

Step 2. Compute the coefficients ajf* for k = 0,1,... , 7 = 2 n — 1, as in 
Example 8.5.7, and obtain 


m = 4>(t) + 4>{t -1) + 4>(t - 2) 

+ (3 + Vs ) (j)(t — 3) H-—— (j){t — 4) + Vs <j)(t — 5) 

1 + \/3 xu ^ , 1 — \/3 xu ^ 

- 2 — W - 6) H--— <f>(t - 7). 

Step 3. Use formula (8.6.6) recursively to compute 


(n—1) (n— 1) (n— 1) (n—1) 


, u Jl 


, u-2 


5 ^3 


and bn 


(n-l) j(n—l) i(n—l) An-1) 


> h K ‘ 


h K 

5 °2 


> °3 
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which gives 


fj™- 1 ) n { n ~ 1 )' 

j Ct/rj • Ct/i • Ct/o • Lin 


{ b ( r i \ b ( r 1 \ b ( r 1 ) , b ( r 1) } = { 


18 — 5%/3 7 + 5%/3 
. 8 ’ 4 ’ 

8 + 3^3 
8 

3 l-y/3 1-6V3 


8’ 4 


Using formula (8.6.6) with the new recursive data 

i , a< n “ 1} , al n “ 1} , b^ , , 


the next iteration gives 


lA 2 ) V” - 


2)l _ j-61 + 21x/3 35 — 21v / 3^ 

4 “ l 32 ’ 32 /’ 

r35 — 11V3 -27 + 3^3-1 


{ b { r 2 ) , b ( r 2) } = 


The next, and final, iteration with the known previous data 

f n ( n ~ 2 ) n^ n ~ 2 ^ h^ n ~ 2 ^ 

\ a 0 ? ^0 >^1 ? • • • 


«r s, } = {5}. K"~ 3) } = { 13+ 3 ^ 1 ' /5 ^ 


Hence, we obtain 


f(t) = ^2 a k Ht - k ) 


<p it /2 - 2k) + b ( k n ~ 1] ip (t/2 -1-2fc) 


X{ 4 " 2 A(V 4 - 4fe ) + 4 ” 2 A(V 4 - 4 - 4fc )} 

fc=o ^ ^ 

+ XI 6 fc ” _1) ^ (*/ 2 - 1 - 2fc ) 


a o ’ <P (t/8) + b { 0 n J> <p(t/8) 


X 2 ^ (*/ 4 _ 1 _ fc ) + X v 1 ^ (*/ 2 - 1 - 2fc ) 
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</(i/8) + 13 + 0 f^ it/8 - 1) + 35 V’ (i/4 - 1) 


32 


32 


27 g^ 3 ^ 3 (i/4 - 5) - | ip (i/2 - 1) + 

-—ip (i/2 - 5) + 0 • ip (i/2 - 7). ■ 


1 — 3\/3 


"0 (i/2 


-3) 

(8.6.7) 
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Integral Equations 


We will confine to numerical solutions of Fredholm integral equations that involve 
orthogonal polynomials and application of quadrature rules. Details about these 
and other types of integral equations are available, e.g., in Atkinson (1976), Baker 
(1978), Porter and Stirling (1993), and Kythe and Puri (2002). Definitions of various 
technical terms and classification of integral equations can be found in most books on 
the subject. We have followed the notation used in Baker (1978), Porter and Stirling 
(1993), and Kythe and Puri (2002). 


9.1. Nystrom System 

For an integral equation of a single real variable, the unknown function will be denoted 
by (j){pc), the kernel of the equation by k(x, s ), and the free term (assumed known) by 
f(x). The kernel and the free term are, in general, complex-valued functions of a real 
variable. We will write Fredholm equations of the first and second kinds in short by 
FK1 and FK2, respectively. Let A ^ 0 be a (complex) numerical parameter, usually 
denoting the eigenvalues of the kernel. The terms ‘eigenvalues’ and ‘characteristic 
values’ are generally used interchangeably in eigenvalue problems, but we will keep 
the distinction between these two terms and denote eigenvalues by A and characteristic 
values by /i, such that fi = 1/A. The Fredholm equations of the first kind (FK1) are 
defined by 

f k(x, s)cj)(s) ds = f(x), a<x<b , (9.1.1) 

J a 


436 
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and of the second kind (FK2) by 


f b 

4>(x) = f(x) + A / k(x, s)cj)(s) ds, a<x<b. 


(9.1.2) 


If f(pc) =0 in [a, b], Fredholm equations are said to be homogeneous ; otherwise they 
are inhomogeneous. The superposition principle applies to linear and homogeneous 
equations only. Fredholm equations are linear integral equations. It is assumed that 
the functions <j)(x) and f(x) belong to the class L 2 [a, b], and the kernel k(x , s) is 
continuous on the square S = {(x, s) : x,sG [a, 6] x [a, 6]}, or is such that k(x , 5 ) 
is square-integrable on S, i.e., 



dx ds = B 2 <00 


on 5, 


and that k(x,s) = 0 for s > x. In terms of the integral operator K defined by 

f b 

(Kcj))(x) = / k(x,s) 4>(s) ds, a < x < b, 

J a 

the integral equations (9.1.1)—(9.1.2) are expressed in terms of the operator K as 
K<j) = /, and (j) = / + A Kcj), respectively. 

A quadrature rule for computing the integral /^(/) of the form (2.6.1) is used to 
compute the integral occurring in Eq (9.1.1). We obtain 

r b n 

/ k(x, s)cj)(s) ds = ^ Wj k (x, Sj ) 0 (sj ), 

Jd j=0 

where 0 denotes an approximate value of 0, and the integral equation leads to the 
eigenvalue problem 


n 

^ Wj k (x, Sj) (j) (sj) = jl 4>(x), a < x < b, (9.1.3) 

j=o 

whose solution gives an approximate eigenvalue A and an associated eigenfunction 
4>(x). The problem (9.1.3) is solved by the Nystrom method , which is as follows: 
Set x = Xi, i = 0,1,... , n, in (9.1.3), which yields the system of (n + 1) algebraic 
equations 


n 

^ Wj k (xi, Sj) (j) (sj) = jl (j) (x^ , i = 0,1,... , n, (9.1.4) 
j=o 
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where the points Xi are called the Nystrom points, a < Xi < b, and Sj are the 

nodes. Setting k = [k (a^, Sj) ], T> = [0 (^o), (j) (xi ),... , /> (x n ) ] , and D = 
diag (wo, wi ,... , w n ), the system (9.1.4) becomes the matrix eigenvalue problem 

kD$ = /i$, (9.1.5) 

which, when solved, yields (n + 1 ) eigenvalues A m = l//i m , m = 0, 1 ,... , n, and 
the associated eigenfunctions 0 m . Note that the solution of the system (9.1.4) or 
(9.1.5) depends on the choice of the values of Xi and that different choices of Xi and 
Sj generate different solutions, where the choice of Sj becomes fixed depending on 
the quadrature rule used. The problem of optimizing the choice of the Nystrom points 
Xi that will yield the best solution is still open. Although it is not necessary to choose 
the Nystrom points Xi same as the nodes Sj,i,j = 0,1,... , n, it is usually done so, 
except in the case when the kernel is not defined at x = s or becomes unbounded 
there. With this choice the determinant of the matrix k in (9.1.5) is symmetric if the 
kernel is symmetric. If /i m ^ 0, the eigenvectors may be extended to a function 
(/) m (x) by substituting it in Eq (9.1.3), that is, 

n 

4>m(X) = Xm^Wj k (x, Sj) <f> m ( Sj). (9.1.6) 

3 =0 

The function (/) m (x) is called the Nystrom extension of the eigenvector 0 m . 
Example 9.1.1. Consider the eigenvalue problem (Baker 1978, p.171) 


/ k(x, s)(/)(s) ds = fu/)(x), 0 < x < 1, 

Jo 

with a symmetric kernel defined for 0 < x < s < lby 

f — (2 — s) if x < 8, 
k(x, s) = < ^ 

y -{2 — x) if x > s. 

The exact eigenvalues are the roots of the equation y/\ + tan y/\ = 0, with the cor¬ 
responding eigenfunctions (j){x) = sin (\/A x) . Thus, the first four exact eigenvalues 
are /l\ = 0.24296, \±2 = 0.041426, = 0.015709. Using a 3-point trapezoidal 

rule on [0,1] we have Q(F) = 0.25 F(0) + 0.5F(0.5) + 0.25 F(l), and choosing 
xo = so = 0, x\ = S'i = 1/2, X 2 = s2 = 1, we find that 

/0 0 0 \ 

kD = 0 3/16 1/16 , 

VO 1/8 1/8 / 

so that the solution of the system (9.1.5) reduces to solving k D — /i = 0, which gives 
the approximate characteristic values as jli = 1/4, /Q = 1/16, and jl 3 = 0. Note 
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that the eigenvector corresponding to fi 3 is = [1,0,0] T . But since ft 3 = 0, we 
cannot use the Nystrom extension formula (9.1.4) to extend the eigenvector ^3 to a 
function <f> 3 (x). Even if we choose different values for xo, say, xq = 1/10 or 1/100, 
we find the same characteristic values as above. If instead of the 3-point trapezoidal 
rule we use the 4-point trapezoidal, or Simpson’s 3/8 rule, the situation remains the 
same; thus, in the case of the 4-point trapezoidal rule we find that = 0.0138889, 
jj>2 = 0.123069, /I 3 = 0.250787, and ft 4 = 0, whereas in the case of Simpson’s 3/8 
rule we get /A = 0.0245766, Ate = 0.0514826, Ate = 0.257274, and </>4 = 0 (see 
nystroml .nb on the CD-R for computational details), and again, we cannot use the 
Nystrom extension formula (9.1.4) to extend the eigenvector ^4 to a function <f> 4 (x). 
Thus, to extend an eigenvector <^ m to an eigenfunction (j)m(x) by the formula (9.1.6), 
it is necessary that the corresponding characteristic value / 2 m be nonzero. ■ 

Example 9.1.2. Consider the eigenvalue problem with the kernel defined on 
( 0 , 1 ] by 



Since the kernel is undefined at x = 0, we shall use a 3-point trapezoidal rule by 
choosing xq = sq = 0, x\ = s\ = 1/2, and X 2 = S 2 = 1. Then we have 

/0 0 0 \ 

k= 0 (ln 2)/2 0 , 

\0 — (ln 2)/\/2 0 / 

and the solution of the system (9.1.5) gives = 0.173287, Ate = Ate = 0- If, i n 
view of the fact that the kernel is not defined at x = 0, we opt to choose the Nystrom 
points as x$ = 1 / 100 , x\ = 1 / 2 , and X2 = 1 , we still get the same values for / m , 
Ate and ^ 3 . Thus, it makes no difference if we choose a different Nystrom point xq. 
In fact, the point xo can be any point in (0,1/2). Hence, for this problem we cannot 
extend the eigenvectors ^2 and <^ 3 . For computational details see nystrom 2 .nb on 
the CD-R. ■ 

An FK2 of the form (fil — K) 4> = f, a < x < b, where k E C[a, b] can be 
approximated by 


n4>(x) - E Wjk(x,Sj) 4>(sj) = f(x), a<x<b. (9.1.7) 
3 = 1 

By replacing x by the Nystrom points Xi, i = 1,... ,n, we obtain a linear system 


n4>{xi) — Wj k (xi, Sj) 4>(sj) = f(xi) , * = 1 ,... ,n, 

3 =1 


or in matrix form 

(/x I — kD) <1 = f, 


(9.1.8) 
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where I is the identity matrix. Each solution 4( x ) of (9.1.7) leads to the solution 
{/> (x \),... , <j) ( x n ) } of the system (9.1.8). Also, if the two solutions of (9.1.7) 
match at the points si,... ,s n , then they match at all points of [a, b\. 

Example 9.1.3. Consider the FK2 



whose exact solution is 4( x ) = 2 y/x/3. We use the 3-point trapezoidal rule with 
xq = sq = 0, x\ = si = 1/2, and x <2 = = 1, and solve the system (I + kD) T> 

f. The results are <f>i = 0, </>2 = 0.471405 and </> 3 = 0.666667, which match the 
exact solution. For computational details see nystrom3 .nb on the CD-R. ■ 

On certain guidelines for using the Nystrom method, see Kythe and Puri (2002, 
P-27). 


9.2. Integral Equations of the First Kind 

Fredholm equations of the first kind, defined by (9.1.1), are inherently ill-posed (see 
Groetsch 1984, Kress 1989, Hansen 1992, Golberg and Chen 1997, Kythe and Puri 
2002), and therefore their numerical solution is difficult. The ill-posedness of an FK1 
generally results in unstable solutions and a small error can lead to an unbounded 
error. We pointed out this ill-posedness problem in Chapter 7 for the inverse Faplace 
transform problem, since Eq (7.1.2) is basically an FK1. Another source of ill- 
posedness is the Riemann-Febesgue lemma. Also, if both (j>{x) and k(x , s) are 
continuous but f(x) is not, then Eq (9.1.1) is not solvable. 

9.2.1. Use of Numerical Quadrature. Partition the interval [a, b] into n 
equal parts of length h = (b — a)/n, and approximate Eq (9.1.1) by 

n 

f(x) h, 

3 = 1 

which after setting x = x \, £ 2 ,. • • ,x n gives 


n 

fi = ^ ^ &ij 4*3 ? 2 = 1,2,... , n, 

3 =1 

where fi = f (xi), kij = k(xi,Sj) h , and (j)j = 4 ( s j)> which form a system of 
n equations in n unknowns 4i • However, the solution so obtained depends on the 
choice of the values of x, and different choices of x yield different solutions. We may 
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choose the nodes Sj the same as the Nystrom points Xi, but it is not always possible, 
e.g., in the case of a kernel that is not defined at x = 5 or becomes unbounded there. 
The quadrature method for FK1 is found to be very unsatisfactory as the following 
examples show. 


Example 9.2.1. Consider the FK1 with k{x,s) = 


x(l — s) if x < s, 
s(l — x) if x > s, 

defined on [0,1]. First, we apply the repeated trapezoidal rule by choosing Xi = 
Si = ih, h = 1/n, for z = 0,1, ... , n. Now, since k( 0, s) = k( 1, s) = k(x , 0) = 
k(x , 1) = 0 for 0 < x < s < 1, we obtain the system 


h^^k(ih, jh) 4>(jh) = /(z/z), z = 0, l,...,n, (9.2.1) 

j=i 

where f(ih) = /(0) = 0 for z = 0 and f(ih) = /(1) = 0 for z = n. But this system 
fails to compute the values 0(0) and 0(1). Suppose that /(0) = /(l)=0; otherwise 
this method yields no solution. Since 


hk(ih,jh ) 


ih 2 (l — jh) if i<j, 
jh 2 (l-ih) if i>j, 


we obtain the system (9.2.1) yields the matrix equation T> = A f, where 


4>=[0(fc) 0(2 ft) 0(3 ft) ... 0(1 -2ft) 0(1 -ft)], 


A = - 


1 

7? 


2 10 0 0 
1 -2 1 
1 -2 1 


f = < 


/O) 
/( 2/0 
/( 3 / 1 ) 


0 


1 


1 

-2 


/(I — 2h) 

V /(I - /i) J 

4>(i h ) = -^2 [1 ((* “ 1 ) /l ) “ 2 f( ih ) + /((* + !)^) ], /(0) = 0, 


/(i) = o. 


Thus, 0(z/z) « — f"[ih ), where it is assumed that / E C 2 [0,1]. This shows that 
the trapezoidal rule is satisfactory only if /(0) = 0 = /(1), and computation of the 
derivative f"(ih) is unstable due to roundoff errors in f(x). 
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Next, if we use the repeated Simpson’s rule, we obtain a similar system of equa¬ 
tions as <f> = A f except that the vector <f> is replaced by 


$ = 


■fch) -0(2 h) -0(3 h) 


L3 3 3 

with h = 1/n and n = 2m. Then 


■ 0(1 — 2 h) 


4 ~ it 
- 0(1 — h) , 


— ^ f"(ih ) if z is odd, 

— ^ f"(ih ) if z is even, 

which gives inaccurate results for <f>. Also, if k (a^, Sj) = 0 for some z and all Sj, or 
if k (xi ,Sj) = 0 for some j and all Xi, we may run into a different kind of problem in 
that det(k) = 0. Moreover, by making an ‘unsuitable’ choice of the Nystrom points 
Xi or the nodes s j , the matrix k may become almost singular or ill-conditioned, which 
leads to unacceptable solutions. 

Finally, if we use Gaussian quadrature rules, then for each point x we can write 

n 

f( x ) = '52w j k(x,s j )<l)(s j ), 

3 = 1 

where Wj are weights connected to the particular Gaussian rule used. As before, this 
would generate a system of n equations in n unknowns 0(sj). If the determinant 
of the system is nonsingular, we find the approximate values 4>(x) of (j){pc) at the n 
nodes in [a, b\. In general, it is convenient to change the interval to [0,1] by a linear 
transformation, provided a and b are finite. However, in most cases the matrix of 
the system is ill-conditioned and this method is not very successful as the following 
example shows. 

Example 9.2.2. Consider the FK1 of Example 9.2.1. The minimum norm 
solution of the equation is (j){pc) = 6x. Using a four-point Gauss-Chebychev rule the 
computed values of 0(x), given in Table 9.2.2, are compared with those obtained by 
Kondo (1991). Obviously, none of these values is acceptable. ■ 


Table 9.2.2 


X 

004 

4>(x) (Kondo) 

0.102673 

6.94159 

202.685303 

0.406204 

-4.59716 

-182.9258184 

0.593769 

-1.61587 

73.620687 

0.897327 

11.2714 

19.482761 



2005 by Chapman & Hall/CRC Press 



9.2. INTEGRAL EQUATIONS OF THE FIRST KIND 


443 


Although not always successful, quadrature methods should not be totally dis¬ 
carded; they sometimes do yield acceptable results (see Baker 1978, Caldwell 1994). 

9.2.2. Regularization Methods. There are eight regularization methods 
which together with the methods discussed in Chapter 7 and certain quadrature rules 
help in obtaining approximate solutions of FK1, and provide useful methods for 
computing <f>. These methods are as follows. 

9.2.2(a) Phillips’ Method. (Phillips 1962) If the function f(x) in Eq (9.1.1) 
is not known accurately, an error e(x) may occur in its evaluation. Thus, we solve 
the modified equation 



ds = f(x)+e(x), 


(9.2.2) 


where e(x) is an arbitrary function except for a condition on its size, and obtain 
a family T of its solutions. But to determine the true solution, some additional 
information is needed. Assuming that ^ is a reasonably smooth function, we choose 
as solution a function from the family T, which is the smoothest in some sense. We 
may use the condition that the function <fi must have a piecewise continuous second 
derivative, i.e., 

nb nb 

/ <j) , '(x)dx = min / (j)"{x)dx. (9.2.3) 

Ja Ja 

We partition the interval [a, b] into n equal subintervals at the points a = sq < < 

S 2 < • • • < s n = b, n (si — Si- 1 ) = b — a, and replace Eq (9.2.2) by the linear 
system 

n 

^WjkijCpj = fi + €i, i = 0, (9.2.4) 

j—o 

where (j)j = <fr(sj), fi = f(xi), Ci = e(xi), kij = k(xi,Sj ), and Wj denotes the 
weights for the quadrature rule used, and on e(x) we impose the condition that 


n 


£^ 2 


= e 


(9.2.5) 


n 

where e is a constant. Another choice is the condition = e 2 ,pi >0, or Eq 

i =0 

(9.2.3) can be expressed in terms of the second difference by 

n n 

£0 ?+1 - 2 <f>i + <f>U l) 2 = min £(A +1 “ 2 fa + </>i-i) 2 , (9.2.6) 

i =0 i =0 

where T> s = [</)§, (j >\,... , ] T , and T 7 * denotes a set of functions that satisfy (9.2.4) 

and (9.2.5). It is assumed in (9.2.6) that <fi vanishes outside the interval [a, b] , and thus, 
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4>-i = (j) n + 1 = 0- If we introduce the matrices A = (wj kij ), where A 1 = (a^-), 
Eq (9.2.4) is written as A <f> = f + e, which implies that 

$ = A -1 (f + c) = A -1 f + A _ 1 e. (9.2.7) 

Thus, the functions (f)j are linear in e* and 

d<pi , . 

— = aij , i,j = 0,1,... ,n. (9.2.8) 

Using (9.2.5) and (9.2.8) and the constraint (9.2.5), we find the conditions which </)j 
must satisfy are 

n 

^ (0j +1 — 2 (j)^ + 0j_i) (<Ti+i,j — 2+ a^-ij) +7 1 Q = 0, (9.2.9) 
j= 0 

for z = 0,1,... , n, together with the constraint (9.2.5), where 7 _1 is the Lagrange 
multiplier. Since both e* and 7 are unknown, we consider the problem as that of 
finding the vector f s satisfying (9.2.4) by minimizing 

n n 

7 52 (7+i - 2 7 + 7-4 + 52 ’ (9.2.10) 

j =0 i =0 

for a given constant value of 7 which is nonnegative in view of (9.2.9). For 7 = 0 the 
problem reduces to that of solving A <f> = f. For 7 > 0 Eq (9.2.9) can be reduced to 

7 B$ s =e, (9.2.11) 


where 


fimj = (%m—2,j -f O-mj 4rr m _|_i ? j -f 

2 ,j = 17 = 0 = 

^4n+2,j j 0, 1, . . . ,74, 

Substituting (9.2.11) into Eq (9.2.7), we find that 

$ s = (A + 7B) _1 f, e=-7B$ s . 

The choice of 7 is the only question left to answer. Since increasing 7 improves the 
smoothness, we must choose the largest 7 that keeps e below its preassigned value. 
In practice, the solution for a few values of 7 is enough to determine the best solution. 

Example 9.2.3. (Phillips 1962, and Baker et al. 1964) Consider the integral 
equation 

f 6 

/ k(x — s)(j)(s)ds = /(t), 

J -6 
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where 


{ 7TZ 

cos — if \z\ < 3, 

0 if \z\ > 3, 

f(x) = (6 - \x\) (l + 2 cos y) + n Sin 

The exact solution of this equation is <p(x) = k(x). The values of ^>(x) obtained by 
using the trapezoidal and Simpson’s rules are presented in Table 9.2.3. Although these 
results obtained using Mathematica are somewhat different from those by Phillips, 
they bear out Phillips’ main conclusions that a well-designed regularization improves 
the accuracy of the solution. The unregularized results using trapezoidal rule were 
quite accurate. For computational details, see phillips .nb on the CD-R. ■ 

Table 9.2.3. 


X 


0.0 

±1.0 

±2.0 

±3.0 

±4.0 

±5.0 

±6.0 

(j){x) (Trapezoidal) 

1.962 

1.538 

0.462 

0.019 

0.0 

0.0 

0.0 

<f>(x) (Simpson) 

2.943 

1.154 

0.693 

0.014 

0.0 

0.0 

0.0 

4>(x) (Exact) 

2.000 

1.500 

0.500 

0.0 

0.0 

0.0 

0.0 

7 

= 0.0011 

2.357 

1.404 

0.387 

0.078 

-0.033 

0.004 

-0.009 

7 

= 0.011 

2.098 

1.476 

0.449 

0.006 

0.041 

0.011 

-0.069 

7 

= 0.03 

2.031 

1.486 

0.489 

-0.006 

0.023 

0.019 

-0.060 

<p(x), 7 

= 0.1 

1.950 

1.488 

0.557 

-0.010 

-0.029 

0.026 

-0.012 

4>(x), 7 

= 0.5 

1.846 

1.477 

0.646 

0.012 

-0.091 

0.017 

0.037 

4>(x), 7 

= 1.0 

1.800 

1.463 

0.679 

0.041 

- 0.100 - 

-0.003 

0.031 


9.2.2(b) Twomey’s Method. Twomey (1963) suggested a simplification 
of the Phillips’ method as follows: Instead of minimizing the expression (9.2.10) 
with respect to e^, minimize it with respect to <pj. Then differentiating (9.2.10) with 
respect to <f>j and taking as the elements of the matrix A, we get 


A T e + 7H$=0, 

where H is the matrix 


/ 1 

-2 

1 

0 

0 • • 

•\ 

-2 

5 

4 

1 

0 • • 

1 

4 

6 

-4 

1 0 • 


0 

1 

-4 

6 

-4 1 0 


V • 





■) 


(9.2.12) 
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Eliminating e from (9.2.7) and (9.2.12), we obtain 

A$ + 7B$ = f, 

where B = (A -1 ) T H. Note that the above equation has the same solution as 
given by Phillips (1962). Twomey (1963) points out that one can use higher-order 
regularization by minimizing the third difference rather than the second difference. 
He also gives an alternate form of the matrix H. But these techniques will work 
only if the matrix A is invertible. In fact, depending on the order of the expected 
smoothness, one can minimize \\L(j)\\ in any norm, where L is a linear differential 
operator. 

Example 9.2.4. We solve Example 9.2.3 by using Twomy’s regularization 
scheme. The results are given in Table 9.2.4 for the values of x E [—3,3]; the values 
of x = ±4, ±5, ±6 are not given since they are found to be close to zero and are, 
therefore, not significant. Also, the values for different values of 7 are not symmetric 
about x = 0. For computational details, see phillips .nb on the CD-R. 

Table 9.2.4. 


X 

7 = 0.0011 

7 = 0.011 

7 = 0.03 

7 = 0.1 

7 = 0.5 

7 = 1.0 

-3 

0.0774 

-0.0031 

-0.0172 

-0.0135 

0.1889 

0.0450 

-2 

0.3821 

0.4640 

0.5052 

0.5628 

0.6514 

0.6824 

-1 

1.4069 

1.4798 

1.4897 

1.4879 

1.4695 

1.4549 

0 

2.3563 

2.0792 

2.0102 

1.9402 

1.8414 

1.8008 

1 

1.3996 

1.4764 

1.4882 

1.4942 

1.4913 

1.4832 

2 

0.3951 

0.4723 

0.5157 

0.5720 

0.6557 

0.6816 

3 

0.0802 

-0.0030 

-0.0207 

-0.0266 

-0.0163 

-0.0055 - 


Essah and Delves (1989) have developed a cross-validation scheme to automat¬ 
ically set two regularization parameters (constraints) introduced into the solution of 
an FK1 by using a Chebyshev series method (see Kythe and Puri 2002, p. 338, for 
details). In view of the use of Laguerre polynomials in Weeks’ method (§7.2.5(c)), 
the Gauss-Laguerre rule (§3.2.3) can be very helpful in Twomey’s method, but no 
approach has been made in this direction. 

9.2.2(c) Caldwell’s Method. Caldwell (1994) compares different methods 
for the numerical solution of FK1. He considers the usual quadrature methods and 
finds that classical quadrature methods do not give good results in general but can be 
useful for special problems. He proposes a modification of the quadrature method by 
replacing the FK1 (9.1.1) by 

nb 71 

4>{si) / k(si,s)ds+ ^2 Ujk(si,Sj) [f (sj) - f(si)] = f(si). 
a 4 = 0 , 
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Clearly, by this method one should be able to compute (j) ( Si ) J b k (s^, s ) ds to a high 
degree of accuracy. However, Caldwell comments that this approach suffers from 
the same defect as quadrature methods but might be better in some cases. In this 
approach, instead of approximating k(x, s)4>(s), one approximates only 4>(s). To 
avoid computation of the weights for each x, he proposes using the midpoint rule. 
This method is based on the assumption <j)(x) is slowly varying and in each subinterval 
(sj , Sj+i) it can be assumed to be constant equal to (/)(sj m ), where Sj m is the middle 
point of the subinterval. The method yields the following equation: 



k(si,s) ds = f(si). 


This method is particularly useful when k(x, s) is badly behaved but 6{x) is not. 

Caldwell also considers the simplest form of the regularization method, which is 
as follows: Consider an FK2 of the form 

f b 

/ k(x, s)cj) e (s) ds + e(j) e (x) = f(x), 

J a 

where e is a small, positive parameter. Then obtain a sequence of solutions (j) e {x) for 
some suitable values of e, and extrapolate the results to e —> 0. Thus, lim e ^ 0 110e (%) ~ 
4>(x)\\ = 0 in the L 2 -norm, but this convergence is not uniform. Lastly, his iteration 
method for a symmetric kernel has the form 


^(n+l) ^(n) + a (f -^^(n)) ? ^(n) 0? 


where a is less than twice the minimum eigenvalue of the homogeneous equation. He 
has shown that this iterative scheme converges to the true solution or to the solution 
with the minimum norm in the case of nonuniqueness. This method can also be 
regarded as a regularization procedure. 

Example 9.2.5. Caldwell (1994) considers the following five equations: 


(i) 


f 1 e xs ct>(s) 

JO 


(Z+1) _ 1 

ds= x + 1 , 


f 1 ■ ,, ■, , sinx — a:cos x 

(n) / sin xs(p(s)ds= - - -, (pix) = x, 

Jo x 2 


(iii) / 
Jo 


—— ds = 1 + ix + e) In (— x e — j <f>(x) = x, 

o x + s + e y J \l + x + e, h J 


(iv) 


f 


x + 8 + e 

<P( S ) 

y/ X T S -\- 6 

1 


: ds 


= - [{2 — 4(x + e)}\/l + x + e + 4(x + e)y/x + e ], c/)(x) = x, 

o 
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(v) / In \x — s\(/)(s) ds 

Jo 

= ^ [x 2 Ynx + (1 — x 2 ) ln(l — x) — x — 0(x) = x. 

Table 9.2.5 gives the results obtained by Caldwell. In this table the last 5 columns 
represent the order of error for the corresponding method and the FK1, and the ‘+’ 
sign indicates that the error is greater than 10°. It is clear from this table that, in 
general, the direct application of a quadrature rule does not give good results. The 
modified quadrature is only a little better, the regularized quadrature gives the best 
results, and the iteration the next best results. For the FK1 in Eq (v) all methods give 
acceptable results. In his computations, the maximum value of n Caldwell uses is 
40. - 


Table 9.2.5. 


Method 

Rule 

(i) 

(ii) 

(iii) 

(iv) 

(V) 

Quadrature 

B oundary-integral 

+ 

+ 

+ 

+ 

1(T 2 


Gauss-Legendre 

+ 

+ 

+ 

+ 

1(T 2 


Gauss-Chebychev 

+ 

+ 

+ 

+ 

1CT 2 

Regularized 

B oundary-integral 

1CT 2 

icr 3 

10° 

icr 1 

1CT 2 

Quadrature 

Gauss-Legendre 

icr 4 

icr 3 

10° 

icr 2 

1CT 2 


Gauss-Chebychev 

icr 2 

icr 2 

10° 

nr 2 

1(T 2 

Modified 

Gauss-Legendre 

+ 

+ 

+ 

10° 

10" 3 

Quadrature 

Gauss-Chebychev 

icr 1 

10° 

+ 

10° 

1CT 2 


Midpoint rule 

10° 

10° 

+ 

icr 2 

1CT 3 

Iteration 

Gauss-Legendre 

icr 1 

icr 1 

10° 

10° 

1CT 2 


Gauss-Chebychev 

icr 1 

HT 1 

10° 

10° 

1(T 2 


Midpoint rule 

icr 2 

HT 1 

10° 

10° 

10" 3 


Other regularization methods, for example by Lavrentiev (1967) and (Tikhonov 
1963), are discussed in Kythe and Puri (2002, p. 337-338). 


9.3. Integral Equations of the Second Kind 

We discuss numerical methods for obtaining approximate solutions of integral equa¬ 
tions of the second kind (FK2) which are defined by Eq (9.1.2). Although quadrature 
rules solve an FK2 and yield its approximate solution <f> = {0(^o), •.., 4>(x n )}, 
these values are used in the Nystrom methods, which are discussed in §9.1. Our main 
objective in this chapter is to present numerical methods based on quadrature that 
compute the approximation solution T>(x). 
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9.3.1. Quadrature Methods. Let A be a regular value of the kernel k(x,s), 
and the functions k(x, s ) and f(x) be at least piecewise continuous on [a, b\. To 
obtain an approximate solution of the integral F(s) ds , we choose a quadrature 
rule Q(F) = £” =0 w j F ( s j), where Wj are the weights and Sj the nodes taken on 
the interval [a, b\. Then we replace Eq (9.1.2) by 

n 

4>(x) - X^Wjkix, sj) <j> ( sj ) = f(x), (9.3.1) 

3=0 

where c/)(x) denotes the approximate solution of the FK2. The solution c/)(x) is 
computed by the Nystrom method after setting x = z = 0,1,... , n. This 
procedure replaces Eq (9.3.1) by 

n 

4> (xi) — A ^ Wj k (xi, Sj) 4> (sj) = f(xi), i=0, (9.3.2) 

3=0 

which in matrix notation is 

(I-AkD) 4> = f, (9.3.3) 

where k = [k (x u Sj) ] T , D = diag (w 0 ,w 1 ,... , w n ), and f = , f n ] T 

Since we have assumed that A is a regular value of the kernel, the system (9.3.3) has a 
unique solution. However, for a choice of a quadrature rule the matrix (I — A kD) in 
the system (9.3.3) may become singular. But under certain restrictions on A, k(x , 5 ), 
and f(x), the matrix (I — AkD) will remain nonsingular provided the chosen rule 
Q(F) yields a ‘sufficiently accurate’ quadrature. These restrictions are discussed 
below. 

Example 9.3.1. (Baker 1978, p. 357) Consider Eq (9.1.2) with A = 1 and 

f x(l — s) if0 <£<s<l, 
k(x. s) = < 

\ s( 1 — x) if 0 < s < x < 1. 

Note that A ^ j 2 7r 2 , j = 0,1, 2,..., is a regular value of the kernel. The solution 
(j){pc) is unique if f{pc) G C 2 [ 0,1]. We choose the trapezoidal rule T with step size 
h = l/n: 

71+1 

T(f) = Y,"hf(jh). 

3=0 


Then Eq (9.3.2) becomes 


77+1 

4>(ih) — h " k(ih , jh ) 4>(jh) = f(ih ), i = 0,1 ,... , n. 

3=0 
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The matrix (I — KD) is nonsingular since A = 1 and A 0 {4 h 2 sin 2 (7r?±/2)} for 
j = 1, 2,... , (n — 1), so that A is a regular value. This yields a unique solution 
0 = [0(0), 0(/7), • • • , 0(1)] T . It can be shown that 0(0) = /(0), 0(1) = /(1), and 
h~ 2 6 2 (j){jh) ± A 4>{jh) = h~ 2 6 2 f(jh) for j = 1 , 2 ,... , n, where <5 is the central 
difference operator defined by 6<j){jh ) = 0 ((j ± 1/2 )h) — 0 ((j — l/2)h). Thus, 
S 2 4>(jh) = 0 ((.j ± l)ft) - 20(jft) ± 0 (O' - l)ft) • ■ 

Example 9.3.2. Consider Love’s equation 

1 r 1 d 

^(*) + - J d 2 + ( X _ S )2 Hs)ds = f(x), ~1<X<1, 


which occurs in electrostatics. For d = —1, we have k(x , s) 
f(x) = 1 ; using the trapezoidal rule, we get 


1 

7r[l + (x — s) 2 ] ’ 


4>(jh - 1 ) 


n+1 

H ih -1 )-hJ2" I-.. , /• — 


= l. 


where h = 2/n, i = 0,1,... , n. The results are given in Table 9.3.2. 

Table 9.3.2. 


n 


8 

16 

32 

64 

X 

= ± 1.0 

1.63639 

1.63887 

1.63949 

1.63964 

X 

= ±0.75 

1.74695 

1.75070 

1.75164 

1.75188 

X 

= ±0.5 

1.83641 

1.84089 

1.84201 

1.84229 

X 

= ±0.25 

1.89332 

1.89804 

1.89922 

1.89952 

X 

= 0.0 

1.91268 

1.91744 

1.91863 

1.91893 


For computational details, see quadrature. nb on the CD-R. Baker (1978, p.358) 
uses the Romberg scheme to obtain the following results, where the underlines indicate 
similar values: 




9 points 

17 points 

33 points 

65 points 

X 

= ± 1.0 

1.63673 

1.63969 

1.63970 

1.63970 

X 

= ±0.75 

1.75183 

1.75196 

1.75195 

1.75195 

X 

= ±0.5 

1.84215 

1.84239 

1.84238 

1.84238 

X 

= ±0.25 

1.89969 

1.89961 

1.89961 

1.89961 

X 

= 0.0 

1.91934 

1.91903 

1.91903 

1.91903 - 
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Restrictions, (i) If the kernel is degenerate, e.g., if 

N 

kW(x,s)=J2 X MS m (s), 

m =0 

then the exact solution of Eq (9.1.2) is of the form 

N 

(j}{x) = /( x) + A ^2 a m X m (x), 

m =0 


where (I — A A) a = b, with 

f b 

dx , bi= f(x)Si(x)dx. 

J a 


Aij = j Xj(x) Si(x) 


Similarly, the solution of Eq (9.3.1) is of the form 

N 

4>(x) = /( x) + A ^ a m X m (x), 

m =0 


where ^1 — A a = b, with 

N N 

Aij = ^ ^ Xj (s m ) Si (s m ), bi = ^ ^ / (s m ) Si (s m ). 

m =0 m =0 

To keep the quantities || A — A|| and ||b — b|| small, we must choose the quadrature 
rule Q(F) according to the behavior of both k(x,s) and f(x). But if the system 
(I — A A) a = b becomes ill conditioned, it may not be possible to compute a. This 
may happen for certain choices of A and k(x,s ) which in turn impart ill-conditioning 
to the whole problem. If this is the case, we will not be able to compute 4>(x). 

(ii) If the kernel k(x,s ) or the function f(x) is known or suspected to be badly 
behaved, we can use the method of deferred correction (see §9. 3. 5(a)). With this 
approach the accuracy of the initial approximation f(x) does not remain important. 
As a rule, we choose a quadrature rule for which we can ‘predict’ the truncation error 

n 

t(x) = <f(x) — A Wj k (x, Sj) f ( Sj) — f(x). 

3=0 

This means that if we want to find an accurate initial solution </>, we should choose 
a quadrature rule such that = sup 0< ^ <n \t (si) | is small. Whether this con¬ 
dition is satisfied depends on the properties of the quadrature rule as well as on the 
properties of the differentiabilty of f(x). Since 

f(x) = f(x) + A / k\(x,s) f(s)ds, 

J a 
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where k\(x , s) is the resolvent kernel, any bad behavior of f(x) shall influence the 
solution 4>(x). 

9.3.2. Modified Quadrature Methods. A quadrature method is modified 
in the case when k(x, s) is badly behaved at x = s by using the following method to 
reduce the error: Write Eq (9.1.2) as 

nb nb 

<j)(x) — A <j)(x) / k(x,s)ds — A / k(x, s) [^(s) — <j)(x)\ ds = f(x), (9.3.4) 

J a J a 

and use a quadrature rule Q(F) to get 

n 

cj)(x) [l — A A(x)] — A £«* k (x, sj) [4> (sj) - 4>(x)\ = f(x), (9.3.5) 

3=0 

where A(x) = k(x, s) ds. Hence, 

n 

4>(x) [l — A A(x)] — A ^ Wj k (x, Sj) (j) (. Sj ) = f(x), (9.3.6) 

j=o 

where 

n 

A(x) = A(x) — ^ Wj k (x, Sj ). (9.3.7) 

3=0 

If we set x = Xi, i = 0,1,... , n in (9.3.7), we obtain by the Nystrom method 

n 

4> (Xi) [l - A A (xi) ] - A £ Wj A: (Xi, Sj) <i> ( Sj) = f (Xi ), 

3=0 


which in matrix notation becomes 

(l-A(A-kD))$ = f, 


where I is the identity matrix, k = (k (xi, Sj ))^., A = diag{A (#o), A (x \),..., 
A (x n ) }, and D = diagjrco, wi,... , w n J. It is important to compute A(x) accu¬ 
rately. This modified quadrature method is useful when k(x,s) is discontinuous at 
x = s and also when k(x , s) is weakly singular (see §9.5). It is found that (j) gives 
better approximations than cj) in the above cases. 

Example 9.3.3. Consider Love’s equation (see Example 9.3.2). Here 



k(x , s) ds 
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Use the trapezoidal rule with h = 2 /n. The values of cj) at x = (—1) (0.25)1 are 
presented in Table 9.3.3. 


Table 9.3.3. 


n = 8 n = 16 n = 32 n = 64 


x = ±1.0 
x = ±0.75 
x = ±0.5 
x = ±0.25 
x = 0.0 


1.63838 

1.751071 

1.84135 

1.89874 

1.91821 


1.63937 

1.75164 

1.84213 

1.89940 

1.91883 


1.63961 

1.75188 

1.84232 

1.89956 

1.91898 


1.63967 
1.75194 
1.84237 
1.89960 
1.91902 ■ 


Another modification is possible in the case when k(x,s) = g(s) k(x, s ) in 
(9.1.2), where g(s) is badly behaved; e.g., g(s) = yfs so that g'( 0) is unbounded. 
Then we use a quadrature rule for products (see §9.3.6), i.e., 

rb n 

/ 9( s ) P( s ) ds = ^ Vj p(sj). (9.3.8) 

Ja j =o 

While a quadrature rule produces a system of the form (9.3.2), the product rule (9.3.8) 
yields a system of the form 

n 

4> (Xi) - A Vj k (Xi, Sj ) 4> ( Sj ) = / (Xi) , i = 0,1,... , n. 

3=0 

If g{x) > 0, then it is possible to develop a Gaussian quadrature to approximate the 
integral (9.3.8). However, this modified method is successful if the functions f(x) 
and k(x, s ) are smooth. Otherwise the product integration method discussed in §9.3.6 
is better to use. 


9.3.3. Quadrature Formulas. If we replace the integral in Eq (9.1.2) by a 

n 


quadrature formula of the form (2.6.1) where Wj 
(9.1.2) becomes 


> 0 and E Wj 

3 = 1 


= b — a, then Eq 


n 

4>(x) — A ^ Wj k (x, Xj) <j) ( Xj ) = f(x) ± Xs(x). (9.3.9) 

3 = 1 


If we set x = Xi, i = 1,2,... , n, and neglect e(x) = £ (xj), we obtain the system 
of algebraic equations for the unknown approximate values of cj) (x^ as 

n 

4>(xi) - A Wj k(xi,Xj) 4>(xj) = f (Xi) , i = l,2,... ,n, (9.3.10) 

j =i 


2005 by Chapman & Hall/CRC Press 





454 


9. INTEGRAL EQUATIONS 


or 


<t>(xi) [1 - Xwik(xi,Xi)] — \<p(x 2 )w 2 k(x 1 ,X 2 ) - 

- A 4> (x n ) w n k (ti ,x n ) = f Oi), 

- \<t>(xi)wik(xi,xi) + <f> (x 2 ) [1 - A w 2 k (x 2 ,x 2 )] - 

-A <j> (x n ) w n k (x 2 , x n ) = f (x 2 ) , (9.3.11) 


A^>(x 1 )w 1 k(x n ,x 1 ) - A0(x 2 )w 2 k(x n ,x 2 ) - 

+ 4> On) [1 - A w n k((x n , x n )] = / (x n ). 


Solve this system and substitute the values of </> {x \),... , ^ (x n ) into Eq (9.3.9). This 
will yield the required approximate solution of Eq (9.1.2). Any quadrature formulas 
can be used for this method. 

Example 9.3.4. (Mikhlin and Smolitskiy 1967, p.286) The plane interior 
Dirichlet problem for the region lying inside a sufficiently small contour C is governed 
by the equation 



(9.3.12) 


where t and r are the parameters that determine the position of points on the contour 
C\r the distance between points corresponding to values of these parameters; v the 
exterior normal to C at r; da the arc length element; <j)(t) the unknown function; 
and f(t) the prescribed function. Eq (9.3.12) is obtained if a harmonic function is 
sought in the form of a potential of a double layer with density (j)(r) (see Kythe 1996, 
p.21). Let C be defined as the ellipse x = a cos t, y = b sint, a = 5, b = 3, and let 
f(t) = x 2 + y 2 = 25 — 16 sin 2 t. Then 



where e = 4/5 is the eccentricity of the ellipse. Thus, Eq (9.3.12) reduces to 


0(r) 



dr = 25 — 16 sin 2 1. 


0.68 — 0.32 cos(£ + t) 


Note that the unknown function <j)(t) is periodic of period i r, i.e., 4>(—t) = (j)(7r — t) = 
4>(t). For quadrature we shall use the trapezoidal rule with 12 intervals of equal length 
7r/6 from —i r to 7r (see Fig. 9.3.1 on page 545). 
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Because of the periodic nature of 4>(t), we adopt the notation: </>(0) = yi, 
4>( 7 r/ 6 ) = ?/ 2 » ^(tt/3) = 2 / 3 , </>(7r/2) = 2/4- This leads to a system of four equa¬ 
tions: 

1.188892/1 +0.3526972/2 +0.311355 2/3 +0.147059 2/4 = 25, 

0.176349 2/1 + 1.344572/2 +0.3234072/8 +0.153678 2/4 = 21, 

0.155678 2/1 +0.3234072/2 + 1.344572/8 +0.176349 2/4 = 13, 

0.147059 2/1 +0.311355 2/2 +0.3526972/s + 1.18889 2/4 = 9, 

which yields 

2 /i = 16.0294, 2/2 = 12.2647, 2/3 = 14.7353, y 4 = 0.970595. (9.3.13) 

The function <j)(t) can now be constructed by expanding it as a Fourier cosine series 

00 

which in view of its periodicity can be written as 4>(t) = a n cos 2 nt. Taking the 

n =0 

first four terms of this series and using the values of 2 / 1 , 2 / 2 ,2/3? 2/4 from (9.3.13), we 
find that 


do + d\ 

+ d2 

+ 

as - 

= Vi 


a 1 

ax 




do + 

2 

2 


a 3 = 

= 2/2 


a x 

ax 

+ 



a 0 - 

2 

2 

a 3 = 

= 2/3 

do - 

- a x 

+ d2 

- 

as = 

= 2/4 


which, with the above values of 2 / 1 , ,2/4> yield do = 8.5, a\ = 7.5294,= 

0, as = 1.18424 x 10 -15 . Ignoring the value of as, which is very small, we obtain 
cj>(t) ~ 8.5 + 7.5294 cos 2 1. This matches with the exact solution (see Mikhlin and 
Smolitskiy 1967, p.287) 

17 128 

4>(t) = — + —— cos 2 1 = 8.5 + 7.5294117 cos 2 1. 

Zi -L ( 

For computational details with the trapezoidal rule, see dir ichlet 1. nb on the CD-R. 
The results obtained from using other quadrature rules are presented in Table 9.3.4. 


Table 9.3.4. 


Rule 

do 

ax 

d2 

as 

Exact solution 

8.5 

7.5294117 

0.0 

0.0 

Trapezoidal (n = 12) 

8.5 

7.529 

0.0 

1.18424(—15) 

Rectangular (n = 12) 

8.5 

7.5294 

0.0 

1.18424(—15) 

Simpson’s (n = 12) 

8.29185 

8.68164 

-1.23377 

0.62602 

Gauss-Legendre (n = 12) 

8.573 

7.10315 

-0.001688 

-0.0662033 

Weddle (n = 12) 

8.50009 

7.48573 

0.0108996 

0.0021237 
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Note that the Gauss-Legendre formula shows poor results simply because we have ap¬ 
proximated the values of <j)(t) in the integrand by those of (j) (ti) (which are 2 / 1 , 2 / 2 ? 2/3» 
and 1 / 4 , respectively). For computational details, see dirichlet2 .nb and dirich- 
let3. nb on the CD-R. ■ 

9.3.4. Error Analysis. Instead of the system (9.3.10), we consider the corre¬ 
sponding homogeneous system (with f (x^ = 0, i = 1,2,... , n). The determinant 
of this system is 

-\w 2 k(x 1 ,x 2 ) ... -Xw n k(x 1 ,x n ) 

1-A w 2 k(x 2 ,x 2 ) ... -A w n k(x 2 ,x n ) 

-Xw 2 k(x n ,x 2 ) ... 1 - Xw n k(x n ,x n ) 

(9.3.14) 

We solve the equation D( A) =0 and determine those values of A for which the 
system (9.3.14) has a solution </> (x^ ^ 0. Note that these values of A approximate 
eigenvalues, which can be used to find approximate eigenfunctions from (9.3.14). 

To find the error, let Dij denote the cofactor of the element in the i-th row and 
j -th column in the determinant (9.3.14). Then the approximate solution of the system 
(9.3.10) is given by 


D( A) = 


1 — A w\ k (xi,xi) 
—Xwi k {pc 2 ,x\) 

—A w\ k (x n ,xi) 


4>{xi) 


EAi/fe) 


3 = 1 


D(X) 


i = 1, 2,... , n. 


We shall estimate how much these approximate values (j) (x^ differ from the exact 
values (p (xi), i = 1,... , n. Assuming that the functions k(x , s) and f(x) have a 
certain finite number p of continuous derivatives, i.e., k E C p (a , b) and / E C p (a , b ), 
the function (j) shall also belong to the class C p (a , b). Let 


mN 


ff (0) = Ub a < x < 6 \<t>{x)\, = uh a < x < b |<AG)|, 

-/V (0) = ub a < x <5 |/(a;)|, 1V (?) = ub a <a;<b {/^(x) , 


ub a < s < x <b 




= uba^s^aKfc 


sA’ s) 


M (0) = ub a < s < K < 6 \k(x, s)|, q = 1,2,... ,p. 


Then, by using Leibniz’ rule (1.1.5), the derivatives of the integrand in Eq (9.1.2) are 
evaluated as 


d q 

dx q 


[k(x,s) 4 >(s)} 


< i? (0) M s (?) cji? (1) M s (?_1) + • • • + c^- 1 ) H {q ~ 1 '> M s (1) 


+ H^ q) M (0) = T (q) (say). 


(9.3.15) 
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If E denotes the maximum modulus of the error e{x) in (9.3.9) when we replace the 
integral k(x , s)(j>{s) ds by the sum, i.e., when we take 


/ 


k(x , s)(j)(s ) ds — E Wj 

3 = 1 


k (x, Xj ) cj) (xj) = e(x), 


so that \e(x)\ < E and |ej | = \e (xj) | < E, then E can be easily evaluated from 
(9.3.15) in the form E < d n T^ q \ where d n is a factor of the formula; thus, for 
example, for the trapezoidal rule: 

and for the Gauss-Legendre rule: 


E < 


(6 - a ) 2n+1 
2n + 1 


1-2-3 ■■■n ] 2 T< 2n ) 

.(n + l)---(2n)J 1 • 2 • 3 • • • (2 n)' 


(9.3.16b) 


We finally obtain the formula 

T (q) = H (0) M (q) + C 1 H (1) + • • • + H (9) M (0) 

< 7V (0) M s (9) + cjiv (1) + • • • + 1V (9) M (0) 

+ |A| (6 — a) 


M (0) M s (9) + cjMU + • • • + MU M (0) 


ff(°) 




where P q and Q q are known. As noted above, the estimate of the error E is then of 
the form 


E<d n T^ <d n (P q + Q q H^). 


Example 9.3.5. (Kantorovich and Krylov 1958, pp.108-111) Consider the 
equation 

H x ) ~ \ eXS <?K S ) ds = l- - — (9.3.17) 

We use the Gauss-Legendre quadrature for the interval (0,1). The system (9.3.11) 
with n = 2 is 

[1 - Xwik(xi,xi)]4>(xi) - Xw 2 k(xi,x 2 ) 4>(x 2 ) = /Or), 
-Xw 1 k(x 1 ,x 1 ) 4>(xi) + [1 - Xw 2 k (x 2 ,x 2 )] <j) (x 2 ) = / (x 2 ). 


Note that A = 0.5, w\ = w 2 = 0.5, and x\ = 0.2113248654, x 2 = 0.7886751346 
(see Abramowitz and Stegun 1968, p.921). Then the determinant of this system is 


D( A) 


0.738582 -0.29534 

-0.29534 0.544334 


= 0.307424. 
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The determinants D\ and D 2 are 


A = 


0.443242 

0.238927 


-0.29534 

0.544334 


0.738582 0.443242 

-0.29534 0.238927 


0.307404, 

0.307374. 


Thus, <t)( Xl ) = D 1 /D( A) = 0.999935, <f>(x 2 ) = D 2 /D( A) = 0.999839, and the 
approximate solution of Eq (9.3.17) is 


4>(x) = 1 + 0.25 


0.999935 e XlX + 0.999839 e* 2 * 


e x - 1 
2x 


The exact solution is (j){pc) = 1. Comparing these solutions at the points 0, x\,x 2 , 
and 1, we find that the difference \4>(x) — 4>(x) \ is 0.000056, 0.000065, 0.000161 
and 0.000301, respectively, which imply that the errors are of the order O (lO -3 ). 

We now compute a precise estimate of the error E. The quantity B has the bound 
(0.738582 + 0.29534)/2 = 3.36318; so we may take B = 3.4. The free term f(x) 
and its derivatives, expanded in series, are 


f(x) 

/'(*) 

/"(*) 


/"'(*) 


/ (4 +) 



X 

12 

x 

6 + 

X 

8 + 

X 

To 4 

X 

~ 12 


48 


x 

240 


1440 10080 


x 

16 

x 2 

20 


or 

60 

x 3 

72 


x 

24 4 
x 2 
f 28 


x 

288 

x 4 

336 


or 

84 


1680 


Then, considering the bounds for /, /', /", /"', f ^ in the interval (0,1), we may 
take 


1V (0) = 0.5 = 1V (1) , 1V (2) = 0.36, 1V (3) = 0.28, 1V (4) = 0.22. 

The kernel and its derivatives are 

k(x,s)=e xs , k^=s l e xs , k^ = x l e xs , z = l,2,3,4. 
Then for their bounds in the interval (0,1) we may take 

M (0) = = ... = M^ 4) = M s (1) = ... = M s (4) = e. 
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Hence, 


Pa 

Qa 


iV (0) Mf> + 4iV (1) Mj 3) + c 2 4 N {2) M s (2) + c 3 4 N {3) M s (1) 
+ N { 4 ) M ( - 0) < 8e < 22, 


|A|(6-a) 


Af<°> + clAf* 1 * Mf) + c2Af< 2 > Af( 2 > 


c5mJ. 3) M, (1) + Mf> M (0) 


= 8e 2 < 60. 


Then T* 4 - 1 = P 4 + Q i H^°\ where denotes the upper bound of 0(s) on the 
interval [0,1]. Next, from (9.3.16b) 


E = d 2 T (4) 


1 rl • 2i 2 T( 4 ) 


5 L3-4J 1•2 • 3 • 4 


1 y(4). 

4320 


thus, c ^2 = . ^ rom (9-3.17) we compute the upper bound S of \4>(x)\ as 

S = 0.25 ( e Xl + e^ 2 ) + lim fl 

a—»o \ 2x ) 

= 0.85936 + 0.5 = 1.35936, 

so we may take S = 1.4, and obtain 

H (0) < 1-4 + [e (3.4)(1)(0.5) + 1] • (0.5)(l/4320)(22) = 

- 1 - [e (3.4)(1)(0.5) + 1] • (0.5)(l/4320)(60) ‘ 


Hence, we get the difference 


\Hx) - 4>(x )| = |A| [1 + |A|- a)] d 2 ( Pa + QaH (0) ) 

= 0.5 [1 + (0.5)(3.4)(e)(l)] -+- (22 + (60)(1.46911) = 0.07166. 


Thus, as we have seen earlier, the error is really of the order 10 -3 , which is con¬ 
siderably lower than the above estimate of .07166. The above estimate, although 
lengthy, has definitely established that A = 1/2 is not an eigenvalue of Eq (9.3.17), 
and, therefore, this equation has a unique solution. For computational details, see 
error 1 .nb on the CD-R. 

If we take n = 4, we find that D( A) = 0.305786, and D\ = 7+ = D 3 = D\ = 
0.30586, thus, </>i = 02 = </>3 = </>4 = 1- The approximate solution is 


4>(x) = 1 + 0.25 


g 0.0694318442 a; g 0.3300094782 a; g 0.669905218 a: 


g 0.9305681556 a: 


e x - 1 
2 x 
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The error at x = 0,1 is the same as for n = 2, viz., 0.000056 and 0.000301, 
respectively. The rest of the analysis also matches that of the case n = 2. Similarly, 
for n = 8 we get D( A) = 0.305786, and the remaining data are the same as in case 
the case n = 4. For computational details for n = 4 and 8, see err or 2. nb and 
error3. nb on the CD-R. ■ 

9.3.5. Expansion Methods. An expansion method for an FK2 of the form 
(9.1.2) determines the approximate solution <f)(x) as a linear combination of the form 
Y^j=o a 3 Pj( x ) °f prescribed functions Pj{x), j = 0, 1 ,... , n, which are generally 
taken as one of the orthogonal polynomials. We use one of the quadrature rules to 
obtain the approximate solution ^ as a linear combination of the form 


n 

4>(x) = cij k (x, Sj) + f(x), where aj = A Wj <j) ( Sj ). 

3=0 

For example, we can use the Chebyshev polynomials Tj(x) of the first kind and 

match them with the vector 0 (so), 0 (si),... ,0 (s n ) ] T , where the nodes Sj and 
the polynomials Tj(x), j = 0,1,... , n, match with each other. If we employ the 
Clenshaw-Curtis quadrature rule (see §3.3.1), we have Sj = cos(j7r/n), and this 
leads to the approximation 


n 

4>( x ) =^2"a m T m (x), (9.3.18) 

m =0 


where 


2 ' ^ i j- • • 

(hn = — ^ " 0^cos — ^ T m ^cos — ^, m = 0,1,... , n. (9.3.19) 

i=1 

Example 9.3.6. Consider the FK2 (Young 1954a,b, El-gendi 1969) 



For n = 8 El-gendi (1969) obtained 

d 0 = 1.415185, d 2 = 0.049385, d 4 = -0.001048, 
clq = —0.000231, a$ = 0.0000195, a\ = = a? = 0. 


This suggests that the solution is symmetric about s-axis, and we can take odd coef¬ 
ficients d 2m + 1 = 0. Thus, we can solve only [n/ 2] equations in the [n/2] unknowns 
d 2m , and obtain the solution (j) at different equally spaced (n + 1) values of x in the 
interval [—1,1]. For example, if we take n = 10, we solve only 5 equations in 5 
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unknowns m = 0,1, 2, 3,4, and get the solution at 11 equally spaced points in 
[—1,1], as given in Table 9.3.6. ■ 


Table 9.3.6. 


X 

0 

±0.2 

±0.4 

±0.6 

±0.8 

±1 

4>{ x ) 

0.65740 

0.66151 

0.67390 

0.69448 

0.72248 

0.75570 


9.3.5(a) Deferred Correction Method. We use either Romberg’s or 
Gregory’s scheme to obtain the approximate solution cj>(x) of the FK2 (9.1.2). We 
first discuss the Romberg scheme (see §2.7). Suppose we have applied the trapezoidal 
rule with step size h = (b — a)/n to obtain the approximate solution <j)(x) = 4 >h(%) 
by solving the system 

71+1 

0h(a ± ih) — A h " Wj k(a ± ih,a ± jh) 0^ (a ± jh) = f(a ± ih ), (9.3.20) 
i=o 

for i = 0,1,... ,n and for h E {fto? 6o/2, ^o/4}, say. Now, if we compute the 
vectors 4^ for h = ho, ho/2 , ft,o/4, we obtain 

3 estimates of each value of 0(a), 0 (a ± /+>)> 0 ( a ± 2ft 0 ), • • • , 0(6), 

2 estimates of each value of 0 (a ± ft,o/2), 0 (a ± 3ho/2 ),... , 0 (6 — ho/2), and 
1 estimate of each value of 0 (a ± /r>/ 4) , 0 (a ± 3/zo/4),... , 0 (6 — /r>/ 4). 
Suppose that 

N 

4>h(a ± ih) = 0(a ± ih) ± ^ /i 2m p m (a ± ih) ± O (/i 27V+1 ) , (9.3.21) 

ra=1 


where the basis functions p m (x), m = 1,2,... ,7V, are independent of h. Then, 
combining the estimates of the values of 0 (a^o) and using the deferred corrections 
that are similar to those of Romberg’s scheme (as in Baker 1978, p.362ff.), we get 


7 [i] / . ., x 40^ / 2 (a ± i/io) — 0/i o (a ± iho) 

<t>ho (° + lh o) = ---o-. 


7 [2] / ... 16 ±/2 (a + *M- C (« + 

Ao ( a + '-15-. 


I[i] 


and so on. This gives 


<t> (a + ih 0 ) — <f) (a + ih 0 ) = O (hi ), 
<j>(a + iho) ~ (a + iho) = O (ho ), 

<j>(a + ih 0 ) ~ ( a + iho) = O (ft®), 
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where the order terms are uniform in i as ho decreases. 

If the integrand k(x, s)(/)(s) in the FK2 is sufficiently differentiable with respect 
to 8, a deferred correction method can be used to obtain the approximate solution <j> 
by using Gregory’s scheme. Suppose that an initial approximation <f>(x) = 4>^°\x) 
is found after using a quadrature rule, say a repeated trapezoidal rule with step size 
h = (b — a)/n. Then we should compute only the vector (a), ( a + 

ft),... , 4>(°\b)] T , where 

n 

$h\ci + ih) — X h " k (a + zft, a + jh) (a + jh ) = /(a + zft), (9.3.22) 

j=o 

for z = 0,1,... , n (compare this with (9.3.20)). If we use Gregory’s scheme instead 
of the repeated trapezoidal rule, we get 



, a + jh) (f>h (a + jh) + Si 


/(a + zft), 
(9.3.23) 


for z = 0,1,... , n, where ^ is Gregory’s correction term to the trapezoidal rule, 
defined by 


6i jt>) = h c m {v m ^ (<£;*>) + (-1)™ A m ^ (<£;a) |, p < n, 

m= 1 

V m i9i ^;b) = A m i9i(x) 

V m i9i U;a) = 

V / x=a 

$i(x) = x\ = k(a + zft, x) 


This scheme uses the forward and backward differences A m and V m , respectively, 
defined for m > 1 by 


A m tf(x) = A m -^(x + ft) - A m -^(x), 

V rn ij(x) = A rn ij(x-mh), 


such that 


= \7 m $(x + mh) = ( m j tf(x + jh), 

3=0 ' 

where (™) denote the binomial coefficients, and the coefficients in (9.3.24) are 
computed recursively by the recursive formula 

c5 = i> 


c 


* 

m 



* 

m— 1 


1 

m + 1 


m = 1, 2,... . 
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(see Henrici 1964, p.252), which gives their values as 

_ 4 _ _ 1 _ _ 1 _ _ 19 _ _ 3 __ 863 

C 1 — 2’ c 2 — 12’ c 3 — 24’ c 4 — 720 ’ c 5 ~ 160’ C 6 — 160480’ 


and so on. Thus, we can write the trapezoidal rule with Gregory’s correction as 



F(a) + 2F(a + h) + 2 F(a + 2 h) + ... + 2 F(b - h) 


+m 

19h 
~ 720 


- 4 CU & ) - AF (“)) - 4 (v2jF(6) - A2jF(a) ) 

(V 3 F(6) - A 3 F(a)) - ^ (V 4 F(6) - A 4 F(a)) 

863 h 
60480 


(V 5 F(6) - A 5 F(a)) , 


where F(b) = F(x)|^_ fe , and so on. 

Now, we can regard the value of obtained from (9.3.22) with Gregory correc¬ 
tion (9.3.23) as the zeroth corrected approximation, which can be improved further 
to by computing 


(j)^ (a + ih) — A h S y^ j " k (a + ih, a + jh) 
j=o 

In fact, if we write d^ 1 ) = we get 


(a + j/i) = /(a + ift) + ^4°^. 

(9.3.25) 


df } - A h " k (a + ih, a + jh) d\ 1] = A S t (A 0) ) , 

3=0 

which in matrix notation becomes 

(I-AkD) d (1) =A<5(4> (0) ) . 


Once dO) is computed, we obtain from the relation 4>0) = T°) + d^A This 
scheme of computing from is known as deferred correction (see Baker 
1978, p.368). 

9.3.5(b) Iterative Deferred Correction Scheme. Once we have com¬ 
puted by the above correction scheme, we compute the vector i > 1, such 
that 

(I - A kD) d (i) ss A 6 (T*- 1 )) , (9.3.26) 

where 


6 



"< 5 0 ( 4 > (i - 1} ) , St ( 4 > (i - 1} ) ) 
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and 6j is computed by substituting ^ for l> in (9.3.24). Note that in 

(9.3.26) k = [k(a + z/z, a + jh)\ , and D = diag(ft/2, ft,... , ft, ft/2), where I is the 
identity matrix. To solve (9.3.26), we compute at each stage 

for i > 1, such that (I — AkD) = A<5 (d^ -1 ^), i > 1, which yields 

|>(i) _ + fi(i) — ^C 1 ) -|_|- 

where we compute 6 (d^) for each next stage. This leads to the final desired ap¬ 
proximation 

The above approximation scheme can also be constructed by using the Lagrangian 
form for Si (^ ; thus, in formula (9.3.24) we write 

p 

Si = h ^ |^(a + jh ) + $i(b — jft) j, (9.3.27) 

j=o 

where $i(x) = Pi and some values of the coefficients are tabulated 

below. 


p 

3=0 

3 = 1 

3 =2 3 =3 

1 

-1/12 

1/12 


2 

-1/2 

1/6 

-1/24 

3 

-109/720 

177/720 

-87/720 19/720 


Note that in the case when the matrix (I — A kD) is ill conditioned, the vector d^ -1 ^ , 
z = 1,2,..., may be computed by Gaussian elimination followed by the above 
iterative scheme. 

6 X — 1 

Example 9.3.7. Let k(x,s) = e xs , f(x) = 1 -,0 < x < l,andA = 1. 

The exact solution is <j)(x) = 1, The trapezoidal rule with Gregory’s correction is used. 
Baker (1978, p.370) has the following results: 

(a) By a single deferred correction, the maximum errors are given in Table 9.3.7. 

Table 9.3.7. 


h 

Trapezoidal 

1 difference 

2 differences 

3 differences 

1/8 

2.42(—3) 

2.97(—4) 

4.22(—6) 

1.33(—6) 

1/16 

6.0(—4) 

3.81(-5) 

3.63(—7) 

4.54(—8) 

1/32 

1.50(—4) 

4.85(—6) 

2.81(-8) 

1.81(—9) 

1/64 

3.75(—5) 

6.13(-7) 

2.42(—9) 

6.86(—10) 
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(b) By iterative deferred correction, the maximum errors ^ are: 


h 

Trapezoidal 

1 iteration 

2 iterations 

1/8 

1.6(—3) 

2.2(—4) 

1.0(—5) 

1/16 

4.0(—4) 

3.0(—5) 

7.6(—7) 

1/32 

1.1(—4) 

1.2(-5) 

1.4(-5) 

1/64 

3.7(-5) 

2.0(—5) 

2.0(—5) 


No improvements over 2 iterations are obtained in 3, 4, or 5 iterations. 

(c) By an iterative correction scheme using 5 differences (i.e., p = 5 in (9.3.24)), the 
values of (j) are: 


X 

h = 1/4 

h = 1/8 

h = 1/16 

Exact 

±1.0 

1.64135 

1.64011 

1.63979 

1.63970 

±0.75 

1.75445 

1.75258 

1.75210 

1.75195 

±0.5 

1.84537 

1.84313 

1.84257 

1.84238 

±0.25 

1.90176 

1.90040 

1.89982 

1.89962 

±0.0 

1.92220 

1.91982 

1.91923 

1.91903 


These results are from Baker (1978, p.370ff). ■ 

Example 9.3.8. (Baker 1978, p. 372) Consider 



c/)(s) ds 
1 ± {x — s ) 2 


= 1 . 


Using the trapezoidal rule with step size h = 1/32 and the Gregory correction, the 
results are given in Table 9.3.8, where ‘iter(s)’ stands for the number of iterations. 

Table 9.3.8. 


X 

trapezoidal 

1 iter 

2 iters 

3 iters 

4 iters 

5 iters 

0.0 

1.918932 

1.919033 

1.919032 

1.919031 

1.919031 

1.919031 

0.25 

1.899516 

1.899616 

1.899615 

1.899615 

1.899615 

1.8996151 

0.5 

1.842291 

1.842385 

1.842384 

1.842384 

1.84238 

1.8423847 

0.75 

1.751876 

1.751954 

1.751954 

1.751995 

1.751954 

1.7519547 

1.0 

1.639643 

1.639694 

1.6396952 

1.639695 

1.639695 

1.6396952- 
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9.3.6. Product Integration Method. We use quadrature rules when the 
integrand is the product of two functions. Accordingly, in the case of an integral 
equation we get 


nb n 

/ k(x, s)4>(s) ds = ^^Vj k (x, Sj) (j) (sj) , (9.3.28) 

a 3=0 

where the weights Vj are defined for various cases in §2.9. The above rule is exact when 
4>(x) is a polynomial of a certain degree on the interval [a, b] or when (j){x) is a piece- 
wise polynomial of a certain degree on the subintervals [a, a + h\ , [a + 2h \,... , [b—h \. 
The approximation (9.3.28) permits us to apply the product integration rule to an FK2 
of the form (9.1.2), which yields the approximation 


4>(xi) - \^2vjk(xi,Sj) 4>(sj) = f (Xi) , i = 0, (9.3.29) 

j =o 

or in matrix form 


(I-AKD) T> = f, (9.3.30) 

where I is the identity matrix, k = (k(x il Sj))^, and D = diag{?Tb v h • • • ?^n}- 

This method is exact for k(x, s ) cj)(s) ds if k(x, s ) is continuous and quadratic in 
each subinterval of [—1,1]. In the case when the kernel k(x , s) is badly behaved at 
s = x, we use the rule (2.9.17), or its modifications. 

Example 9.3.9. Consider the same FK2 as in Example 9.3.6: 

4>{x) + - [ ds = l, -1 <x<1. 

TT 1 + [X — S) 2 

This equation in its general form 

^ x ) + \ J_ x d 2 + {x - s) 2 ^ ds = /(a:) ’ 

was investigated by Young (1954a,b) by the product-integration method. His results 
are as follows: 


X 

0 

±1/5 

±2/5 

±3/5 

±4/5 ±1 

4>{x) 

0.65741 

0.66151 

0.67389 

0.69448 

0.72249 0.75572 
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Compare these with the values of <f>(x) in Example 9.3.6. The values of 4>(x) using 
the trapezoidal rule with step size h are given below. This method gives better results 
for the amount of work involved. ■ 


X 


0 

±1/5 

± 2/5 

±3/5 

±4/5 

±1 

h 

= 0.1 

0.65787 

0.66197 

0.67432 

0.69481 

0.72261 

0.75553 

h 

= 0.05 

0.65752 

0.66163 

0.67340 

0.69546 

0.72252 

0.75567 

h 

= 0.025 

0.6574 

0.66154 

0.67392 

0.69450 

0.72249 

0.75571 

h 

= 0.0125 

0.65742 

0.66152 

0.67389 

0.69449 

0.72249 

0.75572 


Example 9.3.10. Consider an FK2 of the form 4>{x)-\- A f* k(x, s)g(s)0(s) ds 

Cs hv( x s ) 

= f(x), 0 < x < 1, where g(x) > 0 for 0 < x < 1 and — 7 ; has a discontinuity 

at x = s. An example is given by k(x, s) = min{x, s}, 0 < x < s < 1, and 

d hv 

g(x) = e x . Because of the discontinuity in — in this problem, we do not use the 

os 

quadrature rule (9.3.9) with e{x) = 0, but instead use a quadrature rule of the form 


s' 


i{x, 5 } cj)(s) ds = E Vj(x)<f>(jh), 
3= 0 


(9.3.31) 


and then find the solution of the system 


4>{ih) + A ^2vj(ih) g(jh) 4>(jh) = f(ih), 
3=0 


(9.3.32) 


where we have A = 1 , f(x) = 1.25 e 2x — 0.5 e 2 x — 0.25, so that the equation has 
the exact solution <j)(x) = e x . Baker (1978, p.385) has obtained the values of 4>(x) 
given in Table 9.3.10, which are compared with the exact values. The results show 
an error of order O (h 2 ). 


Table 9.3.10. 


h 

x = 0.2 

x = 0.4 

x = 0.6 

x = 0.8 

x = 1.0 

1/10 

1.2334 

1.5158 

1.8561 

2.2665 

2.7612 

1/20 

1.2245 

1.4978 

1.8306 

2.2355 

2.7292 

1/40 

1.2221 

1.4933 

1.8242 

2.2280 

2.7209 

Exact 

1.2214 

1,4918 

1.8221 

2.2255 

2.71828- 
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9.4. Singular Integral Equations 

Singular integral equations occur (i) with a semi-infinite or infinite range; (ii) with 
a discontinuous derivative in either the kernel or the free term; (iii) with either an 
infinite or nonexisting derivative of some finite order; or (iv) any combination of these 
cases. Consider a singular equation of the second kind (SK2) of the form 


(I + \K)<t>(x)=f(x), 


(9.4.1) 


where K is the singular operator. Then 

(a) Eq (9.4.1) has finitely many solutions {</>i(x),... , (j) n (x)}. 

(b) A necessary and sufficient condition for a solution of Eq (9.4.1) to exist 
is that f r f{pc) ipj(x) dx = 0, where {^(x),... , 'ip rn (x)} is a maximal finite set 
of linearly independent solutions of the transposed homogeneous singular equation 

(x) = 0. 

(c) The difference between the number n of linearly independent solutions of the 
homogeneous singular equation (Kcj)) (x) = 0 and the number m of linearly inde¬ 
pendent solutions of the transposed homogeneous singular equation {K Tr ijj) (x) = 0 
depend only on the characteristic part of the operator K and is equal to its index, i.e., 
n — m = v (for the for the definition of index v, see Muskhelishvili (1992, p.90) and 
Polyanin and Manzhirov (1998, p.638)). 

(d) The number of linearly independent solutions of characteristic equations is 
maximal among all singular equations with a given index v. In particular, (i) iiv > 0, 
then the homogeneous singular equation (K s (j))(x) = 0 has v linearly independent 
solutions; (ii) if v < 0, then the homogeneous singular equation (K<j))(x) = 0 
has only the trivial solution; (iii) if v > 0, then the nonhomogeneous singular 
equation (K s (j))(x) = f(x) has, in general, v linearly independent solutions for 
an arbitrary function f(x); and (iv) if v < 0, then the nonhomogeneous singu¬ 
lar equation (K s (j))(x) = f(x) is solvable iff f(x) satisfies the (—v) conditions 
f r tyj(x) f{pc) dx = 0, j = 1,2,... , —v, where T is a simple closed contour, 
4/ j(x ) = x^- 1 /Z(x), and Z(x) denotes the fundamental solution of the homoge¬ 
neous equation. 

9.4.1. Singularities in Linear Equations. We consider the following 

cases: 

Case 1. The functions k(x,s ) and f(x) are piecewise continuous, with jump 
discontinuities only along lines parallel to the coordinate axes. If the free term f(x) 
is badly behaved, its form and nature of singularities are propagated into the solution 
4>(x). To remove this type of singularities, we write (j)(x) = tjj(x) + f(x) and solve 
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the equation 


f b 

= A / k(x, s)tjj(s) ds + A 
J a 



(9.4.2) 


Alternatively, we use a single function ^(pc) that has the ‘badness’ of f(x) propagated 
into (j)(x), and set <j)(x) = tjj(x) + 7(2;), so that f(pc) — ^(x) becomes well behaved. 
Then we use a quadrature rule to approximately solve for y'(x) the equation 

ip(x) — A f k(x, s)^(s) ds = [f(x) — j(x)] + A 

J a 


/ 


k(x, 5 ) 7 ( 5 ) ds, (9.4.3) 


which in turn yields 4>(x). This method is successful only if f b k(x, s)tjj(s) ds or 
f b k(x , 5 ) 7 ( 5 ) ds are smooth functions of x, and especially if k(x , 5 ) is smooth. 

Case 2. If the function f(x) behaves badly because of a discontinuity in a 
derivative, a high-order accuracy from a quadrature rule is not generally obtained 
since <j)(x) may be affected by such behavior of f(x). 

Case 3. Discontinuities in the kernel k(x,s ), which lie on lines parallel to the 
5-axis, pass on to the solution 4>(x). In this case a quadrature rule or a collocation 
method is generally not applicable, but the product integration with a suitable choice 
of orthogonal polynomials Pi(x) is needed to complete the solution in this case as 

n(x 5) 

well as in the case of the kernel of the form k(x , 5 ) = --—^, 0 < a < 1. 

15 — 5 1 1 

Case 4. When the kernel k(x , 5 ) is weakly singular, see §9.5. 


Case 5. Some special cases of the convolution-type kernels of singular integral 
equations of the form k(x,s) = k(x — s) are as follows: 

(i)) If the interval of integration is [a, 00 ), we can apply the Fourier transforms to an 
FK1 or FK2, provided we assume that f(x) <0 for x < a. Consider an FK1 



)<t>(s)ds = /( x). 


(9.4.4) 


The method described in Kythe and Puri (2002, p. 182) yields the solution for 
Eq (9.4.4), under the Dirichlet condition for x > a and under the assumption that 

XT \f( x )\dx < 00 , as 


4>{x) = 


f oo J,, r oo fe c (Af) cosnfj,(s - x) + k a (fj,) sin7r/z(s - x) 

Jo J a ~ 0/ x , 7 0/ x 


*!( m ) + klin) 


if x > a, 
if x < a. 


where k c (n) and k s {fi) denote the Fourier cosine and sine transforms of k(x — s) = 
k(r ), defined by 

rOO rOO 

k c (n) = / k(r) cos it fir dr, k s (fi) = / k(r) sin7r fir dr. 

Jo Jo 
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For a = 0, Eq (9.4.4) is known as the Wiener-Hopf equation. 

(ii) If the interval of integration is (a, b) , then the solution for Eq (9.4.4) is similarly 
given by 


m = f °° d V f 

J — oo J a 


where 


kcAv) = 


b k c (rj) cos 7rfi(s — x) + k s (r]) sin7r fx(s — x) 

k s ( v ) + k %{ ri ) 


POO , x f COS 

[_ k( r ) \ Trprdr if a < x < b, 
00 [ sin 


f(s)ds, 

(9.4.5) 


0 


if x < a, b > x. 


(iii) For an FK2 of the form 


n OO 

4>(x) — A / k(x — s)4>(s) ds = f(x), (9.4.6) 

J a 


the solution is 


<t>(x) = { 


r oo , r oo k c (p) COS 7 TfJ,(s - x) + k s (p) sin 7 T/i(s - x) 

JO k Ja To/ \ To/ \ \ rfo To"! J \^) ^ 


k s(d) + k c(p) - A [k 2 s + kl 


if x > a, 
( 0 if x < a. 


(9.4.7) 

(iv) If the interval of integration is (— 00 , 00 ), then by applying the convolution 
theorem of the Fourier integral the solution for an FK1 of the form k(x — 
s)(j)(s ) ds = f(x) is given by 


x) = / k(x — s)f(s) ds, 


(9.4.8) 


where 0(ix), &(?/), and f(u) denote the Fourier transform of (j){pc), k(x), and f(x), 
respectively, and 1 /k(u) = k{u). In the case of an FK2 of the form (9.4.6) the 
solution is given by 

/ oo 

k\(x - s) f(s)ds. 

-OO 


Example 9.4.1. Consider the FK2 of the form (9.4.4) on the interval (0, 00 ). 
Divide the domain x > 0, 5 > 0 into four parts, marked by dotted lines x = 1 and 
8 = 1, and let fen, k\ 2 , & 21 , and ^22 denote the values of the kernel k(x — s) in these 
parts. Then the singular equation (9.4.4) becomes 


cj)(x)—X^J ku(x, s)cj)(s) ds + J k 2 i(x, s)cj)(s) ds 

+ J ki 2 (x,s)<f)(s)ds-\- k 22 (x, s)0(s)dsj = f(x). 
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For the integral over the interval (1, oo), set 1/s = cr; then, for example, 


i; 


& 2 s)</>(s) ds = 




We then choose the nodes (lattice points) as, e.g., in Fig. 9.4.1 (see page 546), and 
solve the system of four simultaneous equations. For example, consider k(x , s) = 

e -2(x+s) and = I We p ut I = ^ I = ^ = $(£), / = F(£), 

and obtain 





c + i' 


Taking the four representative points (£, a) as in Table 9.4.1, we have 

4.7 <j>i + 3.4 (f>2 + 1.5 4> 3 + 1.2 = 9.0(+9), 

11.1 (pi T 7.1 (p2 + 3.2 (p 3 + 2.4 (pi = 3.0(+3), 

4.6 0i + 3.4 02 + 1.5 fa + 1.1 cpi = 4.0(+2), 

14.4 (px + 10.5 (p 2 + 5.4 (p 3 + 3.6 (p A = 5.0(+l). 

The solution is given in Table 9.4.1. For computational details, see singular .nb on 
the CD-R. 


Table 9.4.1. 


5 

<j 

£ 

£ = i/£ 

(p{x) 

0.15 

6.67 

0.8973 

1.1145 

—1.818(—10) 

0.85 

1.18 

0.5938 

1.6841 

—7.733(—10) 

1.18 

0.85 

0.4062 

2.4615 

—4.191(—10) 

6.67 

0.15 

0.1029 

9.7371 

1.047(—10) 


9.5. Weakly Singular Equations 


For a weakly singular kernel of the form 


7 , . q(x , s) 

k(x , s) = -— , 0 < a < 1, 

v 1 |x-s| a 

(9.5.1) 

the resolvent is given by 

D\(x, s) 

Dm • 

(9.5.2) 
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and the solution of the SK2 with a weakly singular kernel of the form (9.5.1) is given 
by 





(9.5.3) 


For weakly singular equations the interpolatory quadrature rules described in Chapter 
2 are not applicable because k(x , s ) is unbounded if we assume that g(x , s) ^ 0 in 
(9.5.1). However, the product integration method can be used successfully for such 
equations. A modified quadrature method described in §9.3.2 can be extended to solve 
weakly singular equations. Since k(x , s) is weakly singular, we have unbounded 
values in Eq (2.9.19). Let 


jl + A A* (sj) ) 4> (si) — A Vj k ( St , Sj) <j> (. sj) = f (s*), 


3=0 

31^1 


where 



Then we set k(x, s) {(j)(s) — (j){x)} to zero at the singularity x = s. Finally, from the 
computational point of view, the Galerkin or collocation methods are applicable to 
weakly singular equations (see Baker 1978, p.532). 

9.5.1. Product Integration Methods. In some problems the integral in 
an FK2 is singular in the sense that one or more derivatives of k(x,s) have singularity 
within the interval of integration. In such a case we write k(x, s ) = u(x, s ) k(x, s ), 
where u(x, s ) is singular in (a, b) and k(x, s ) is a regular function of its arguments. 
It is assumed that this factorization of k(x, s ) is feasible; otherwise the method does 
not work. Moreover, u need not be unbounded at x = ,s to create a singularity; u 
can be a function like u(x,s) = \/x — s , where all derivatives with respect to s are 
unbounded at x = s, and p is thus singular in the above sense. Two examples of such 
integral equations are of the form 



Thus, we write the FK2 as 



•b 


(9.5.5) 
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and to approximate its solution we use the product integration method; because of the 
singularity occurring in the kernel, this method is adapted to this situation by using 
the quadrature rules of §9.3.2 in the above two cases as follows. 

Case 1. When k(x,s) = \x — s| -c \ 0 < a < 1, we take k(x, s) = 1, 
and partition the interval [a, b] into subintervals by choosing nodes Sj = a + jh, 
h = (b — a)/n,j = 0,1,... , n. However, the points Sj need not be equally spaced. 
Then use the quadrature rule 

b n 

k(x, s)(j)(s) ds = Vj (j) ( Sj ), 

3=0 

where the weights Vj can be chosen as described in §2.9. This rule is exact if the 
function (j){pc) is either piecewise constant in [a, b], i.e., constant in each subinterval 
[sj, Sj+i], j = 0,1,... , n, or continuous and piecewise linear in [a, 6], or a smooth 
function, i.e., a polynomial of degree n on [a, b] . Once we decide on the choice of the 
weights Vj , we apply the Nystrom method and solve the system of algebraic equations 

n 

4>(xi) - AyNN(U = / (xi), i = 0, (9.5.6) 

3=0 

Example 9.5.1. Consider the case of the weakly singular equation with the 
kernel fc(x, s) = \x — s| -1//2 , for which we use the quadrature rule 

1 n 

x _ s \i/2 Fds = E v 3 (*<) F ( s i)’ 



where F(x) is any function defined on [a, b ]. This rule is an extension of the repeated 
trapezoidal rule, where the weights are taken as 

1 f Sl 

v o = T Oi - s) k(x m ,s) ds, 

h J So 

v i = \{j s (s-s 1 . 1 )k(x m ,s)ds 

f Sj + 1 1 

+ / (s j+ 1 -s) k(x m ,s) dsy j 

JSj > 

Vn = ~hJs ( s ~ Sn ~^ k ( Xm,s ^ ds ’ 


(9.5.7) 


= 1,2 ,... ,n- 1, 


where x m = a + mh. Thus, in this example, in order to compute Vj for j = 
0,1 ,... , n, we are required to compute 


1 

h 



(.Sj — s) ds 
I |V2 

Sm S 


and 


1 

h 



(s — Sj- 1 ) ds 

~\ 11/2 • 
Sm S 
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Atkinson’s Technique. Atkinson (1976) suggests the following method to 
compute the above integrals: take 8 = Sj-i ht, 0 < t < 1; then these integrals 
reduce to 

'■AiAiU' '■’TiA 

respectively, where q = m — j + 1, — n ± 1 < q < n. Hence, we notice that these 
n 2 weights v 3 are reduced to the above integrals with respect to t over [0,1], which 
can be computed analytically: 




= /U 2 


r— 

Jo \m - 


— t 


Vn = h 1/2 f 

Jo 


-t I 1 / 2 
— t 


dt , 


dt , j = 1, 2, ... , n — 1, (9.5.8) 

1 — t 


m — n + 1 — 1 1 1 / 2 


dt. 


Note that the weights Vj can be similarly evaluated for the logarithmic kernel In \x — s\ 
or any other difference kernel k(x — s). ■ 


Example 9.5.2. (Baker 1978, p.541) Consider the equation 


) —A j \x — s\ 1//2 (j>{s) ds = /(x), — 1 < x < 1, 


(9.5.9) 


with A = 2/3 and f{x) = (l — x 2 ) 3//4 — —(2 — x 2 ). The exact solution is 

4>{x) = (l — x 2 ) 3//4 , which is not differentiable at x = ±1. We choose Sj = jh — 1, 
h = 2/n, and using the weights (9.5.8) we solve the system (9.5.6). The results for 
n = 5 are given in Table 9.5.2. 


Table 9.5.2. 

X 

±1.0 

±0.6 

±0.2 

Error 

—2.55(—2) 

2.25(—2) 

1.27(—1) 


The rate of convergence is slow. The maximum error is as follows: 6.18(—2) for 
n = 10; 2.3(—2) forn = 20; 1.22(-2) forn = 30; 7.66(-3) forn = 40; 5.48(-3) 
for n = 50; 4.25(-3) for n = 60; and 3.42(-3) for n = 70. ■ 

Phillips (1969) uses a polynomial collocation method for solving Eq (9.5.9); he 
has calculated the accuracy both analytically and theoretically and obtained an error 
of about 3 x 10“ 2 with a polynomial of degree 7 (by solving a linear system of 8 
equations) and an error of order O(l0 -3 )by solving a system of 30 equations. 
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Case 2. When k(x , s) = In \x — s|, we may take, as in case 1, s) = 1 and 
use the above method to solve the FK2. But instead, following Atkinson (1966), we 
choose u(x, s) = \x — s| -1 / 2 and k(x, s) = \x — s\*-t 2 k(x,s). This choice of k(x, s ) 
is continuous but not smooth for 0 < x,s < 1, and u(x,s) becomes unbounded at 
s = x. However, such a choice enables us to investigate the behavior of the method 
under bad computational conditions. Moreover, the method becomes very effective 
if we use trapezoidal rule (9.5.6) with weights defined by (9.5.8), that is, 

/ b 71 

12- _ s |l/2 U s ) ds = Vj F ( Sj ), 

which leads to the system of equations 

n 

<t> (Xi) - A Vj K (Xi, Sj) <t> ( Sj ) = / (Xi ), i = 0,1,... , n. (9.5.10) 

3 = 0 

Example 9.5.3. Consider Eq (9.5.4b), where A = 1, and 

f(x) = x — — jx 2 lux + (l — x 2 ) ln(l — x) — x — — }. 

The exact solution is <p(x) = x. The system (9.5.10) becomes 

n 

4>( x i ) -^2 v 3 \ x i “ s j| 1/2 ln U - = f( x i) , 

j=0 


or 

(i - *D) 4> = f, 

where /c = (k (a;*, Sj))^, and D = {^o ? • • • , w n }. Using the 4-point trapezoidal 

rule we get <p i = 3.47916, </>2 = 0 = ^ 3 , and ^4 = —4.74689, which are very bad 
results. For computational details see logkernel .nb on the CD-R. ■ 

Example 9.5.4. (Baker 1978, p.549) Let k(x, s) = Y 0 (\x — s|), where Y 0 (x) 
is the Bessel function of the second kind and order zero (also known as Weber’s 
function of order zero). Note that 


Y 0 (x) = - 
7r 


ln (f) +7 l Jo{x) + k {°¥~ 


2 2 4 2 V 1+ 2 


2 2 4 2 6 2 


( 1 + W^)"'"}’ 


where Jo(x) is the Bessel function of the first kind and order zero. The function 
Y 0 (x) is unbounded at x = 0 , so we take u(x,s) = \x — s| -a and k(x,s) = 
\x — s| a Yo (\x — s|). ■ 
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Baker’s Method. (Baker 1978, p.550) Consider an FK2 of the form (1.2.2) 
with a = 0 and b = P, and suppose that the kernel k(x, s ) is expressed in terms 
of complete elliptic integrals of the first and second kind; i.e., we take k(x,s) = 
P(x, s) In \x — s\ + Q(x, 5 ), where P(x, s) G C[0, P] and Q(x, 5 ) has a singularity 
at x = s. The free term f(x) is such that (j) E C[0, P]. Baker (1978, p.559) mentions 
a work by Kershaw who solved this equation by using the quadrature rules 



I F(s)ds = vij F (sj), 
3-0 


f 


Q(x, s ) F(s) ds = F ( s j) > 

3 -0 


jh, h = P/n, 


(9.5.11) 


where each rule is exact if F{pc) is piecewise polynomial. Then the approximate 
solution of the given FK2 is obtained by solving the system 


4> (Xi) - A (ui,j P (Xi, Sj) + v 2 ,j 

3=0 


}4>(Sj) = f(Xi)- 


This analysis lead to a general case when the kernel k(x,s) can be represented by 


M 

k(x,s) = fc(x, s, m), (9.5.12) 

m =0 

where k(x,s,m) can be split as 

k(x, 8, m) = u(pc, 8, m) k(x, s , m), (9.5.13) 


such that k(x, 5, m) G (7[a, 6] and ^(x, 8, m) are weakly singular. Then we use the 
quadrature rule 



)F(s) ds 


v m,j P ( s j)> 

j=0 


which leads to the approximation formula 


M n 

4 >(Xi) - A yNm.j K(Xi,Sj,m) 4 >(Sj) = f (Xi) . 
m=0 j=0 


Note that, in general, we will obtain different approximate values 0 from different 
choices of the kernels k(x, s, m) because its representation (9.5.12) is not explicit. 
Also, each function k(x,s,m) may be written in many different ways as the product 

u(x, s, m) k(x, 8, m). 
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Example 9.5.5. (Atkinson 1966) Consider 

(a )k(x,s) = \x — s| _1//2 k,(x, 5 ), where k(x, s) = \x — s| 1//2 ln | cosx — coss| G 
C[0, 7r], since if cosx = cos 8, then x = s + 2m7r, m = 0,1, 2,..., and when 

d 

0 < x, s < 7r, this implies x = s. This case satisfies all conditions except — kOe, 8) 

C/S 

is unbounded at x = 8. The results obtained, though poor, are given in Table 9.5.5a. 


Table 9.5.5a. 


n 

4>n(i r/2) 

Error 

4 

0.59065 

0.28 

8 

0.44853 

0.13 

16 

0.38764 

0.073 

32 

0.35347 

0.38 


(b) k(x, s) = In | cos x — cos s\, 0 < x, s < 7r, which we can write in the form 
(9.5.12) with M = 4 as 


X — 8 


Ko(x, 8) = In 


( X — 8 J 


2 sin 


x — 8 


Ki(x,s)=lnU f , 

( (x + 8 )( 27 T — X — S) J 

K 2 (x, 8) = ft 3 (x, 8) = K 4 (x, 8 ) = 1, 

^0(25 8) = (x, 8)1, 

u 2 (x, s) = In \x — 8|, 

Us(x^ 8) = ln( 27 T — X — 8), 

^4(2;, 8) = \n(x + 8). 


Thus, 


k(x, s) = In cos x —cos 8 = ln<j 


X — 8 . X + 8 

sin- sm- 


(^2^)( X + 5 )( 27r_X_5 ) ^ 

+ In |x — s| + ln(27r — x — s) + ln(x + 8) 

4 

= E K m(a;,s), 

m=1 

where, as defined above, u m (x, s) are badly behaved whereas ft m (x, 8) are regular. 
The exact solution of this equation is 


<f>(x) = 


1 + 7r In 2 


: 0.314704298033644. 
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Using trapezoidal rule, Atkinson (1967) found the results given in Table 9.5.5b. 


Table 9.5.5b. 


n 

<t>n(0) 

Error 

Relative error 

2 

0.3051691 

0.009535 

3.029 

4 

0.3122181 

0.002486 

7.9(—1) 

8 

0.3140722 

0.000632 

2.0(—1) 

16 

0.3145453 

0.000159 

5.0(—2) 

32 

0.3146644 

0.000039 

1.267(—2) 


Using Simpson’s rule, Atkinson (1967) found the results given in Table 9.5.5c. 


Table 9.5.5c. 


n 

^n(0) 

Error 

Relative error 

2 

0.32449048976 

0.0002138 

6.7(—2) 

4 

0.31468781777 

0.00001648 

5.2(—3) 

8 

0.31470316978 

0.000001129 

3.5(—4) 

16 

0.31470422550 

0.000000073 

2.3(—4) 

32 

0.31470429345 

0.000000005 

1.5(—6) ■ 


The representation (9.5.12) for the kernel k(x,s) leads to an error of the order 
O (/i 3 ), but the error increases if <j)(x) is badly behaved, or if one of the factors 
K m (x, s) has a badly behaving derivative. 

Atkinson achieves an error of O (ft, 4 ) in the case of the kernel of Example 9.5.5. 
An error analysis for the product-integration method is provided by de Hoog and 
Weiss (1973b), who establish that the maximum local truncation errors at the nodes 
are O (ft 4 In ft). In practice, the product-integration formulas mentioned above are 
not easy to use. 

Atkinson (1972) has suggested a hybrid method , which is as follows: First, notice 
that the integrand with a singular kernel of the form (9.5.2) makes computational 
integration very difficult only when s is close to x. If we remove the disk | s — x | < 6 , 
6 > 0, from the interval of integration [a, b], then any one of the quadrature rules 
given in Chapters 2 and 3 can be used to approximate the solution over the interval 
[a, 8 — S] U [5 + <5, b], where the quality of results will depend on <5. The integral over 
the remaining interval (s — <5, 8 + S) can then be handled by the product-integration 
methods, where we can take care of the singularity at x = 5 . For example, suppose 
that sq = a, s n = b , and Sj = sy_i + ft; then set 6 = h and use the repeated 
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trapezoidal rule, say, which gives 
h 


2 ^2 [k(xi,Sj) 4>(s j ) + k(x i ,s j+1 ) 4>(s j+1 )} 


3=0 
3& 
3 &~1 


[ x% 1 ( S - Xi -1 

A(l-^o) / -5 -— g(xi,Xi)4>(xi) 

J x % -\ S l ^ 


— 5 ~ j 

+ 5 Sj-i) <f> (si-i) f 


- a ri - 


(i-^o) r 1 \ s Xi 

Jx r \Xi - s\ y 


Xi — S 

Xi-\-\ s 


g(xi,Si +1 )<t>(s i+1 ) 


h 


p(o: i ,s i )^(s j+ i)| 


*^z+l $ 


g (xi, sj ) 4 > ( Sj) = / (x^ , i = 0,1 ,... , i 


where Sij is the Kronecker delta, and k(x, s ) is defined by (9.5.2). 

9.5.2. Asymptotic Expansions, de Hoog and Weiss (1973b) derive a 
generalized Euler-Maclaurin formula for product integration based on piecewise La- 
grangian interpolation, and derive asymptotic expansions for three cases of the func¬ 
tion u(x, s): (a) when u(x, s ) is regular; (b) when u(x, s ) is singular and of the form 
\x — s| a , 0 < a < 1, as in (9.5.4a); and (c) when u(x, s ) is of the form In \x — s|, as 
in (9.5.4b). Special cases of (b) and (c), i.e., |$ — s\ a and In |$ — s\, 0 < $ < 1, are 
also considered. Note that case (i) belongs to §9.5.1, so we shall present the formulas 
for cases (b) and (c) here. 

Consider an SK2 of the form (9.5.5) with a = 0, b = 1, where the kernel is 
represented as 


k(x,s) = Y,u j (x,s)k j (x,s), (9.5.14) 

3 = 1 

where the functions u 3 (x, s) and (x, s) satisfy the following conditions: 

(i) k 3 [x, s) G C[ 0,1]; 

(ii) / | Uj(x, s)| ds < +oo; and 

Jo i 

(iii) lim / I Uj (or, s ) — Uj (x 2 — s) I ds = 0 uniformly in x\ and x<i- 
ki-^ho J o 

Special cases of Uj(x,s) are mentioned above in (b) and (c). Therefore, we 
consider the special case k(x, s ) = u(x, s)k(x, s ). Choose the nodes for the interval 
[0,1] as 0 < si < 52 < ... < s n < 1, and let Xi = z/zforz = 0,1,... , m, h = 1/m. 
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We denote Xij = Xi + Sjh for j = 1, 2,... , n. Define 

n 

Ax)= n (x-sj), 

3 = 1 

and the Lagrangian interpolating polynomials 




Then the computational scheme for the approximate solution 0 of the FK2 is given 
by 


'ij ~ f ( X ij ) + ^ EE Wi p K(Xij,i 


sip) ( 9 . 5 . 15 ) 


for i = 0,1,... m — 1; j = 1,2,... , n, where 


f Xl+1 (i 

W ip {x) = j u(x,s)l p ^- 


and 4>ij denotes the numerical approximation to <j> ( x , 3 ). Atkinson (1967) shows that 
if A is a regular value of the kernel, then (9.5.15) has a unique solution for sufficiently 
small h and max \<j) ( x ^) — fa* I = 0(E ), where the error 

0<i<m— 1 1 1 

1< j<n 


E = ^max EE Wi p K(x ij ,Si p )4>i p - / ds . 

1 /=Q p=1 0 

The special cases for the error term are as follows: 

When u(x, s) = \$ — x \ a , 0 < ft < 1, or 8) = |x — 8| a , 0 < a < 1, 


E = o(h n As) ds) + O (h 


n+1 — a\ . 


when u(x, s) = In |$ — x|, 


E = o(h n As) + O (h n+1 ); 


when u(a:, s) = In |a: — s|, 


E = 0[h n ir(s)ds) +0(h n+1 In h) 
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The asymptotic expansions technique developed by Lyness and Ninham (1967) has 
been used to develop corresponding expansions for the two cases when u{pc,s) is 
singular. Thus, for the case when u(pc,s) = \x — s| a we have 


m— 1 

h | xi + fth — Sij 
1=0 


'4>(xi+ fth) = [ 

Jo 


s — x, 


13 


a 


(\ x ~ x ij) I a <Ks)ds 

q =0 q ’ ^ 


x=0 


d q 

+ (- 1 ) 9 C(-Q, 1 ~^ + d^(\ x ~ Xi i) ds 

p foq+l-cx r 


x=l 


E 

q=0 


7! 


C (a - q, ft - Sj) + (-l) g C(a-q,l + Sj - ft) (j) q ( x^) 


+ O (xjj - ah p+1 ^j + O ^(1 - x) 1 a h p+1 ^j , 0 < < 1 , p > 0 , 

(9.5.16) 

where h = h/xij , and £(o, n) is the periodic zeta function defined by ((a,n) = 


( [a, ftj , 0 < 1 ? < 1 , such that ft — ft is an integer, and ((a, x) is the generalized 
Riemann zeta function. Again, for the case when 1/(25 s) = In \x — s|, a formula 
similar to (9.5.16) holds except that the term \x — Xij\ a is replaced by In \x — Xij | 
and the last two error terms are replaced by O (in h p+1 ) + O (in (1 — x^) h p+1 ), 
where h = h/ (1 — x^). 


Example 9.5.6. de Hoog and Weiss (1973b) consider the SK2 


</>{x) = 1 + 


P7T 4 

/ Uj (25 s) Kj (25 s)4>(s) ds , 

Jo 3 +1 


0 < X < 7T, 


where 


Ki(x, 


| sin (( 2 : — s)/ 2 ) 

l ((*-«)/ 2 ) 



sin ((x + s)/ 2 ) 1 

(( 2 : + s)(27t -x-s)) J 


1/2(25 <s) = In |x — s|, 1/3(2:, s ) = ln( 27 r — 2: — s), 

1/4(2:, s) = In(2; + s), 1/1 = ^2 + ^3 = ^4 = 1. 

Compare this example with Example 9.5.5, where Atkinson (1967) applies the product 
Simpson’s rule. Although the convergence rate was observed to be of the order O (h 4 ), 
only 0(h 3 ) convergence was established. ■ 

9.5.3. Modified Quadrature Rule. A quadrature rule of the form 

/ b n 

f(s)ds = '^2 w j f (sj), a < sj < b, j = 0,1,... ,n, (9.5.17) 

j =o 
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can be used to compute an approximate solution <j)(x) of Eq (9.5.3) as follows: Write 

{ 1-A / \x^-s\ a ds ) ^~ X j [H s )-H x )] ds = /(A (9.5.18) 

If 0 G [a, b \, where (3 > a, the integrand in the second term on the left side tends 
to zero continuously as x —» 5 . The quadrature rule is then applicable and yields the 
approximate values 0(si),z = O,l,... , n, where 


(l-AG(sj) } 4>{si) - A ^ wj [0(sj)-0(sj)] = /( s i) - (9.5.19) 

j =0 — S 3 | 


where 


G{x) = f 
J a 


g{x,s) 

\x — s| a 


ds. 


The values 4>(si), i = 0,1,. .. , n, will then define a function (f>(x) by piecewise 
constant or piecewise linear interpolation if a < so or b > s n , or by polynomial or 
spline interpolation. 

Example 9.5.7. (Baker 1978, p.535) Let k(x,s) = ln|x + s|, and define 
g(x,s) = \x — s| a In \x + s|, 0 < a < 1, and g e C[0,1]. Then k(x,s) = 
n(x S ) 

, 7 = In I x + s|. The kernel k(x,s) is weakly singular and square-integrable, 

\x — s| a 

i.e., k(x, s) G L 2 [0,1]. FortheSK2 


(j){pc) — f In \x + s| 0 (s) ds = /(#), 0 < x < 1 , 

Jo 

we can use the modified quadrature rule (9.5.20) with 

G(x) = / In |x + s| ds = (x + 1 ) ln(x + 1 ) — x\nx — 1 . 

Jo 

The exact solution of Eq (9.5.20) is (j){pc) = x if we take 


(9.5.20) 


x" , x ~ (x +1) 2 (x + 1) 2 


f (x) = x -\ -lnx- 

j \ j 2 4 


ln(x + 1 ) + 


which corresponds to G(x). This modified quadrature rule is applied using the 

(a) (n + 1 )-point repeated midpoint rule, 

(b) n-times repeated trapezoidal rule, and 

(c) repeated Simpson’s rule with (n + 1) points. 
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The results are given in Table 9.5.7 for different values of n (Baker 1978, p.535). 
The error seems to be of the order O (h 2 In h ). ■ 


Table 9.5.7. 


n 

(a) 

(b) 

(c) 

2 

1.16(—2) 

5.52(—2) 

1.16(—2) 

4 

4.27(—3) 

1.37(—2) 

3.45(—3) 

8 

1.34(—3) 

3.43(—3) 

9.74(—4) 

16 

4.31(—4) 

1.05(—3) 

2.64(—4) 

32 

1.33(—4) 

3.14(—3) 

6.95(—5) 

64 

3.98(—5) 

9.18(—5) 

1.80(—5) 

128 

1.16(—5) 

2.64(—5) 

4.58(—6) 


Example 9.5.8. Consider the FK2 

(j){x) — f In \x — s\ <j)(s) ds = f(x), 0 < x < 1, (9.5.21) 

Jo 

whose exact solution is <j)(x) = x for 

f(x) = x — ^ jx 2 ln.T -f (l + x 2 ) ln(l — x) — ^ }• 

Using the modified rule (9.5.21) with the repeated Simpson’s rule, we compute <f>(x) 
for different step sizes h. The results are given in Table 9.5.8 (see Baker 1978, p.537). 


Table 9.5.8. 


h \ x 

0.0 

0.25 

0.5 

0.75 

1.0 

1/2 

1/4 

—1.3(—2) 

—3.6(—3) 

3.6(—12) 
7.5(—5) 3.6(—12) 

—7.5(—5) 

1.3(-2) 
3.6(—3) 

1/8 

—1.0(—3) 

1.9(—5) 

7.3(—12) 

—1.9(—5) 

1.0(—4) 

1/16 

—2.7(—4) 

3.1(—6) —1.5(—11) 

—3.1(—6) 

2.7(—4) 

1/32 

—7.1(—5) 

4.4(—7) 

7.3(—12) 

—4.4(—7) 

7.1(—5) 

1/64 

—1.8(—5) 

5.8(—8) —2.2(—11) 

—5.8(—8) 

1.8(—5) 


The values at x = 0.5 are correct up to the level of roundoff error; the maximum 
error occurs at x = 0 and x = 1, and the rate of decrease is that of order O (h 2 In h) 
as h decreases. The errors at the points x = 0.25 and x = 0.75 decrease faster than 
the above order. ■ 
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9.6. Cauchy Singular Equations of the First Kind 


A Cauchy singular equation of the first kind (CSK1) is defined in the complex plane 
C by 

- -f pQ-dC = f(z), (9.6.1) 

l7T Jr C — z 

where Y is a closed or nonclosed contour in C with z = x + iy, and ( and z are 

(complex) points on Y, <J>(z) is the unknown function, --is the Cauchy kernel, 

S % 

and f(z) is the free term. The integral on the left side of Eq (9.6.1) exists only as the 
Cauchy p.v. If T is a closed contour, special cases of Eq (9.6.1) are the following: 

(i) A CSK1 on the real axis has the form 


— ds = f(x), —OO < X < DC. 

- X 

(ii) A CSK1 on a finite interval [a, b\ has the form 

— -f ds = f(x), a < x < b < oo. 

7T J a S-X 



(9.6.2) 


(9.6.3) 


In Eqs (9.6.1)-(9.6.3) it is assumed that all functions satisfy the Holder condition. A 
general form of a CSK1 in C is 


1 

Z 7 T 


/r 


flUC) 

(- Z 


d( = f(z), 


where g(z, () is a given function that satisfies the Holder condition with respect to 
both variables, and all other functions satisfy the Holder condition as in Eqs (9.6.1)- 
(9.6.3). 


1 

If in Eq (9.6.1) we replace the variable z by (j, multiply by — --, integrate 

ITT — Z 

along T, and change the order of integration by using the Poincare-Bettrand formula 
(1.1.7) with g(z, z) = <J>(z) in this case, then we obtain 


w Jr Ci - ^ ^ Jr w Jr 


d( i 


it u — ^ ™ Jr Ln Jr (Ci — ^)(C — Ci) ’ 

where the second integral on the right side for a closed contour Y is 

dt 1 1 ( r dt 1 f dCi \ 1 


£ 


(Ci C-z\J rCi-C JrCi-zJ C-Z 


£ 


(in — in) = 0. 
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Hence, the solution of Eq (9.6.1) for a closed contour T is 

i r /(O 


m = f / 

ITT J r 


C-z 


d(. 


9.6.1. Use of Trigonometric Polynomials. Consider a CSK1 on the 
interval [—1,1] defined by 

_ f _|— f k(x, s)(j)(s) ds = f(x). (9.6.4) 

7T J _i s — x 7r J _ i 

This equation is encountered in problems of aerodynamics and plane elasticity (see 
Kalandiya 1973). We consider the following three cases. 

Case 1 . Solution unbounded at each endpoint. According to 
Mushkhelishvili (1992), this solution is of the form 




9 U) 

\/l — ' 


(9.6.5) 


where g(x) is a bounded function on [—1,1]. Substituting (9.6.5) into Eq (9.6.4) and 
setting x = cos 6, s = cos cr, 0 < #, cr < 7r, we get 


1 f 1 g(cosa) 


£ 


7T COS <7 — COS 6 


da + — j k(cos 6, cos cr)g(cos cr) dcr = f (cos 6). 


We replace the function g(x) by the Lagrange interpolation polynomials l n with 

2772 — 1 

Chebyshev nodes x m = cos 0 m , 6 m = ——-7r, m = 1,... , n, where 


2n 


In (g-, cos6) = - ^T(-iy +1 g (cos0j) 


cos ncr sin 


0 * 


i=i 


cos 6* — cos 0 7 - 


(9.6.6) 


For each j the fraction on the right side of (9.6.6) is an even trigonometric polynomial 
of degree < (n — 1), and 


i r 
K Jo 


7T J n COS <J — COS 0 

We write (9.6.6) as 


cos ncr sin n6 ^ ^ 

dcr = ———, n = 0,1,2,... . 


L 6 ’ 


n—1 


^ It/ fO -L ^ / 1/ 

l n (g\ cos 6) = — g (cos <9j) cos ^ cos m#-^ g (cos <9j). 

7=1 m=0 7=1 

Then we obtain the following quadrature rule for the singular part of Eq (9.6.4): 

n n—1 


1 jf*4 (b(s'} 2 ^ 

' ds = —— -E g (cos 6j) E cosmOm sinm#. (9.6.7) 

7=1 m=l 


£ 


7r 8 — x nsin# 
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This formula is exact only in the case when g(s) is a polynomial of degree < (n — 1). 

For the second integral (regular part) on the left side of Eq (9.6.4) we use the 
relation 


1 f 1 P(x) dx 

7T J_ 1 y/l — X 2 


1 

n 


P (cos Qj), 

3 = 1 


where P(x) is a polynomial of degree < (2 n — 1). Then 
1 /T ^ n ^ 

— / k(x, s)cj)(s) ds = — (cos 6, cos 6 j) g (cos 6 j) . (9.6.8) 


j=i 


Thus, substituting (9.6.7) and (9.6.8) into Eq (9.6.4), we get 


2 

rising 


n n —1 ^ 

y>(cos^) x cos sin m# H— 

j = 1 m=l 


n 

^ k (cos 0 , cos ) g (cos ) 
j =1 


= / (cos 0). 

If we set # = 0^, z = 1,... , n, and use the relation 


(9.6.9) 


n —1 


yy cos mOj sin mOi 

in 1 



(9.6.10) 


where the db sign is chosen according as |z — j | is even or odd, we obtain from (9.6.9) 
the following system of linear algebraic equations: 


X a H 9j= fu fi = f (cos 0i), 

3 = 1 


— 


1 

n 


esc 0i cot 


Qj ± Qj 

2 


i = 1, • • • ,n, 
k (cos 6, , cos 0j ) 1, 


which determines the approximate values of ^ = g (cos0j). This solution for ^ is 
then substituted into (9.6.6) and (9.6.5) to obtain the approximate solution 0 of Eq 
(9.6.4) at the nodes Xj. 

Case 2 . Solution bounded at one endpoint. Let the solution be 
bounded at the endpoint x = — 1. Then we take 


<t>( x ) = \Jy~^ MA (9.6.11) 

where h(x) is bounded on [—1,1]. We choose the same interpolation nodes as in 
Case 1, replace h(x) by the trigonometric polynomial 


l n (h ; cos#) 


1 

n 


X( _1 )' ?+1/l ( cos6, 4 

3 =1 


cos n6 sin#j 
cos 6 — cos Qj ’ 


(9.6.12) 
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and substitute the result into the singular part of Eq (9.6.4). This gives the following 
quadrature rule for the singular part of Eq (9.6.4): 


1 
7r 



0(s) 1 — cos 6 

s — x n sin 6 


n n —1 

^ h (cos 6j) cos m6j sin m6 

j = 1 m =1 


1 

n 


n 

3 = 1 


(9.6.13) 


which is exact only if h(s) is a polynomial of degree < (n — 1). The quadrature rule 
for the regular part of Eq (9.6.4) is 


r i 2. n . 

/ k(x, s)4>(s) ds = — Ed — cos 6^) k (cos 6, cos 6j) h(cos6j ), (9.6.14) 

7- 1 n i=1 


which is exact only if the integrand is a polynomial of degree < (2n — 2). Now, after 
substituting (9.6.13) and (9.6.14) into Eq (9.6.4) and using 6 = 6i (i = 1,... , n) and 
the relation (9.6.10), we obtain the following system of algebraic equations: 


ENL=/i, fi = f (cos 9i), i = l,...,n, 

3 = 1 


bij — 

n 


Oi 6i ± 6j . o Oj / N 

tan — cot —— 1 + 2 sin k (cos , cos Uj) 


which determines the approximate value h 3 = h (cos 6j ). This solution for h 3 is then 
used in (9.6.12) and (9.6.11) to obtain the approximate solution 0 of Eq (9.6.4) at the 
nodes x 3 . 

Note that if the solution is unbounded at the other endpoint x = 1, we take 


0 (*) = 


Case 3. Solution bounded at both endpoints. In this case the solution 
<j)(x) must satisfy the boundary conditions </>(—1) = 0 = 0(1). We approximate 
4>(x) by an even trigonometric polynomial in #, which is constructed for the nodes 
Xj = cos Oj of the corresponding Chebyshev polynomial of the second kind, namely, 
by 


M n (0; cos 6) = 


Eu c 

3 = 1 


n 


i0 j) E sm 

m=1 


m6n 


im6. 


(9.6.15) 


This leads to the following quadrature rule for the singular part of Eq (9.6.4): 


1 
7T 



5 — x n + 1 


n n 

^ 0 (cos 6j) sin cos m0, 

j = l m=l 


(9.6.16) 
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which is exact for any odd trigonometric polynomial (j) of degree < n. For the regular 
part of Eq (9.6.4) we use the relation 



x 2 P(x) dx 


7r 

n ± 1 


n 

^ sin 2 Oj P (cos Oj ), 

3 = 1 


(9.6.17) 


where P(x) is a polynomial of degree < (2n — 1), as in Case 1. Thus, in view of 
(9.6.17), the quadrature rule for the regular part of Eq (9.6.4) is 

If 1 i n 

— J k(x, s)cj)(s) ds = —— sinOj k (cos 6, cosOj) (j) (cosOj). (9.6.18) 

Now, after we substitute (9.6.16) and (9.6.18) into Eq (9.6.4) and set 6 = 0^, i = 
1 ,... ,n, we obtain the following system of algebraic equations: 


^2 c ijhj=fi, fi=f(cos6i), i = 1,... ,n, 
j =i 


L 6 A 


2e 7 - 


n + 1 L cos — cos 
f 0 for even | i — j |, 
\ 1 for odd \i — j\. 


+ k (cos , cos ) 


Once this system is solved for hj = h (cos Oj ), the approximate solution (j) is computed 
from (9.6.15). When using this method, it is important to have the approximate 
solution of the form 

4>(x) = (1 — x) a (1 + x)^ 4/(x), (9.6.19) 

where a = ±1/2 = /?, and ^(x) is a bounded function on the interval [—1,1] with 
well-defined values 4/( —1) and 4/(1). If the representation (9.6.19) holds, then this 
method is also applicable to Cauchy singular integral equations of the second kind 
(CSK2) discussed next. 


9.7. Cauchy Singular Equations of the Second Kind 

A singular equation of the second kind with a Cauchy kernel (CSK2) is generally of 
the form 

a(x) (j>{x) ± — -f X ' ^ (j>{s) ds = f(x), (9.7.1) 

m J r s — x 
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where T is a closed or nonclosed contour, and 8 and x are points on T. It is assumed that 
the functions a(x), (/)(x), and f(x) satisfy the Holder condition on T and the function 
g(x,s) also satisfies the Holder condition on T with respect to both variables. The 
kernel of Eq (9.7.1) can be written as 

g(x,s) _ g(x,s) -g(x,x) t g(x,x) _ 
s — x s — x s — X 

and if we set g(x,x) = b(x) and ^ X ^ = iirk(x,s ), then Eq (9.7.1) 
takes the form 

a(x) (j)(x)-f ds + [ k(x, s) 4>(s) ds = f(x), (9.7.2) 

nx J T s-x J T 

where b(x) satisfies the Holder condition on T, and k(x, s) satisfies the Holder con¬ 
dition everywhere on V except at the points s = x, where we have \k(x,s)\ < 
A\s — x\~ a , A a . positive constant, and 0 < a < 1. Eq (9.7.2) is taken as the stan¬ 
dard form of a CSK2, where a(x) and b(x) are called the coefficients of the equation, 

- the Cauchy kernel, k(x , s) the kernel of the regular part, and f(x) the free 

s — x 

term. The first term on the left side of Eq (9.7.2) is also known as the characteristic 
part of the equation. 

Eqs (9.7.1) and (9.7.2) can be written in the operator form as 

(K0) (x) = (K s + K r ) (x) = /(*), (9.7.3) 

where K = K s is known as the singular operator such that the equation 

(. K s q !>) (x) = a(x)(j)(x) + 1 ^ s _ f( x \ (9.7.4) 

in J T s — x 

is called the characteristic equation for Eq (9.7.2), and the operator K s is sometimes 
called the characteristic operator. For the regular part of Eq (9.7.2) we have 

(K r cj)) (x) = J k(x,s)cj)(s) ds , 

where K r is called the regular (Fredholm) operator. Thus, Eq (9.7.2) can be written 
as 

(K<l>) (x) = (K^) (x) + (K r <l>) (x) = f(x). (9.7.5) 

The equation 

(K T cj))(x)=a(x)(j)(x) —— / d s -[_ f k(s,x)(j)(s) ds = g(x) (9.7.6) 

m J T s-x J T 
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is the transposed CSK2, where K T is the transposed operator of the operator K. 
The equation 

(( K s ) t (p) ( X) = a(x)4>(x) ~ — ~f ds = g(x) (9.7.7) 

V / 27T Jy S — X 

is the transposed characteristic equation to Eq (9.7.4). Note that (K S ) T ^ (JC T ) s , 
where 

(( rT ) A) = a W ^ x ) - ds ■ (9.7.8) 

Z7T Jy S — X 

Some examples of CSK2 include the following: 

(a) Consider the CSK2 

>. b f 1 <f>(s)ds { . . 

aMx) H— 4 - -= f(x), -1 < x < 1, 

7r J_ 1 s — x 

where, without loss of generality, we can take a 2 + b 2 = 1. We have three cases: 

(i) Solution bounded at both endpoints: 

4 , (x) = af(x) -tI I a!fim±, ( 9 . 7 . 9 ) 

nj-i9(s) s ~ x 

where g(x) = (1 + x) a (l — x) 1_a , and a is a root of the equation 

a + b cot(7rcy) = 0 (9.7.10) 


on the interval 0 < a < 1. The above solution exists iff 



m 

9 ( s ) 


ds = 0. 


(ii) Solution bounded at the endpoint x = 1 and unbounded at x = — 1 is given 
by (9.7.9) with p(x) = (1 + x) a (l — x)~ a , where in this case a is the root of Eq 
(9.7.10) on the interval — 1 < a < 0. 


(iii) Solution unbounded at both endpoints: 


<p(x) 



d( x ) f(s) ds 
g(s) s-x 


Cg( x), 


where g{x) = (1 + x) a (l — x) 1 a ,C is an arbitrary constant, and a is a root of 
Eq (9.7.10) on the interval 0 < x < 1. 

(b) Tricomi equation 


cj)(x) — A 



1 


s — X 


1 

x + s — 2 xs 


4>(s) ds = /(#), 


0 < x < 1, 
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has the solution 


(f){x) 


1 

1 + A 2 7T 2 


f( x ) 



1 

X + S — 2xs 


f(s ) ds 


C (1 — x)d 

x l+f3 


where C is an arbitrary constant, and 

2 

a = — tan -1 (A7r), — 1 < a < 1, 

7 r 
2 

(3 = — tan _1 (A7r), — 2 < (3 < 0 . 

7 r 

Eq (9.7.1) can be solved in a closed form if a(pc) = a and 6(x) = b are constants 
and the kernel k ( x , s ) is analytic in each variable in the domain = Int(r), where 
T is the (closed) boundary of this domain. Then Eq (9.7.1) becomes 


a <t>(x) + A 7 «^(s) ds = f(x), 

11T J v S — X 


where g(x, s) = b — iir k(x, s ), and the solution is given by 


<t>{x) 


1 

a 2 — b 2 


f ( x ) 


1 

77T 


£ 


sM 

S — X 


f(s) ds 


a ±b. 


9.7.1. Gauss-Jacobi Quadrature. Erdogan and Gupta (1972), Erdogan, 
Gupta and Cook (1973), and Krenk (1975) show that by a proper choice of collocation 
points both CSK1 and CSK2 can be solved using the Gauss-Jacobi quadrature rule. 
Consider a CSK2 in its general form 


Cli (j>i(x) 


hf 

K 7-1 


, , , ds 
4>i(s) -b A 


S — X 


N r l 

u. 


kij( x , s)(j)(s) ds = fi(x ), \x\ < 1, 


(9.7.11) 

for j = 1,... ,7V, where and bi are real constants, the kernels kij(x,s) G 
H ([—1,1]), and the free terms fi(x) are known functions. The unknown functions 
4>i(x) or their first derivatives have integrable singularities at the endpoints x = ±1. 
A general closed-form solution of Eq (9.7.11) is not known. However, for numerical 
solution based on the Gauss-Jacobi quadrature rule Erdogan, Gupta and Cook (1973) 
have found a group of fundamental functions defined by 


u>i(x) = (1 — x) aj (1 + x)P 3 , (9.7.12) 


where 


1 . dj — ibj 

Cij = —— log —--A + Nj 

3 2m dj + ibj 3 


A ‘° g 


J ^ 

1 , dj — ibn 


ibj 


Mj 
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Nj and Mj being integers for j = 1 ,... , TV, and for each of the TV equations in 
(9.7.11) the index Kj of the integral operators is defined by 

Kj = — (oLj P f3j) = — (Nj P Mj) , j = 1,... , TV. 

Since we have assumed that pi or their first derivatives have integrable singularities at 
the endpoints, the index must be —1,0,1 (see Mushkhelishvili 1992). The numerical 
solution of Eq (9.7.11) is given by 


M x ) = 9i( x ) mix), 


where 

oo 

9i(x) = ^2 Ci i L'° ,/3) (A (9.7.13) 

i= 1 

Here (x) are Jacobi polynomials of degree n with indices a and /3, and are 
constants to be determined. The general scheme is to truncate the series (9.7.13) for 
i = 1,... , n, and determine methods to compute the unknown coefficients dj. We 
discuss this problem below for a simple case of Eq (9.7.11), but the method can be 
easily extended to Eq (9.7.11). 

9.7.2. Solution by Jacobi Polynomials. For the sake of simplicity we 
consider a special case of Eq (9.7.11) of the form 

ap(x)p—-f <j)(s) —^—bA [ k(x,s)<j)(s)ds = f(x), \x\ < 1, (9.7.14) 

7T ./-I S-X 7-1 

for which, by using the orthogonality properties of the Jacobi polynomials, Erdogan, 
Gupta and Cook (1973) derive an infinite system of linear algebraic equations 


<f>(x) = 5T Cn w ( x ) p N\ x )i (9.7.15) 

n =0 


where w(x) = (1 — x) a (l+x) /3 andc n , n = 0,1 ,..., are constants to be determined. 
Before substituting (9.7.15) into Eq (9.7.14), note that for the index n = (—1,0,1) 
we have (see Tricomi 1957, Szego 1939) 


— -f w(s) p^ p) (s) d S = cotfira) w(x) P^^\x) 

7r 7-i s- x 

2 a+ ^r(o)T(n + /T +1) ( \-x\ 

-F7—i- , o i o F[n + l,-n-a-fcl-a- , 

7rT(n P cl P fj P \) V 2/ 

- 1 < x < 1, > -1, + 0,1 ,... , > - 1 , 

/ \ f 1 fa — ib\ 

cot(7ro) = cot7r - log -- + TV 

v 7 L 2z7r \aPibJ 


= a P (3 = —k, 
b 


(9.7.16) 
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and 

Pi 


= ra-airfa-t + i) F (" +1 -- n+K ’ 1_o; Y)' (9 - 7 - 17) 


r(i — a) r(n — k + 1) 

Hence, combining (9.7.16) and (9.7.17), we get 


b C 1 

a w (x) p( a ’® (x) H — 7 w(s) (s) 
TT J-l 




s — X 


= — 2 “ 


^ r ( a ) r (i 


(9.7.18) 


hi < 1. 


Then, substituting (9.7.15) into Eq (9.7.14) and using (9.7.18), we obtain an infinite 
system of algebraic equations 


£< 

n =0 


2~ K b 

sin(7ra) 


U-7 l3) (x) + h n (x)] =/( x), 


(9.7.19) 


where 


h n (x) = A /: w(s ) P^^ (5) k(x, s ) ds, 


Now, we use the orthogonality relations 


f 1 Pi^Hs)Pt 0 Hs)w(s)ds={ * 
7—1 l Um 


\x\ < 1. 


if n ^ m, 
if n = ra, 


for m = 0,1, 2,..., where 


0(a,/3) = 2a+/3+1 r(m + a + l)r(m + /?+!) n , „ 

m 2m + a + (3 + 1 m! T(m + a + /? + 1) 


and 


^(a,/3) _ j d s — 


2 a+/3+l p( Q + 1 ) r (/5 + i) 


r(ci + (3 + 2 ) 


Then we truncate the series (9.7.19) to obtain 


2-*6 
sin(7rci) 

where 


A 


$ra( Cl? /^) Cra+K T ^ ^ C^ nm C n — Fm ? Tfl — 0, 1, . . . , iV, (9.7.20) 


m=0 


d nm = / P^ a ’ /3) (x)ri;(-ci, -(3,x)h n (x)dx, 


-l 


Fm = J pL 0 \x)w(-a, -P,x)f(x)dx, (9.7.21) 


;(—ci, — /?,x) = (1 — x) a (l + x) ^ = w 1 (x) 
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There are three cases to consider. 

Case 1. k = — 1: Note that the first term of the series (9.7.19) is equal to a 
constant multiplied by Co P[~ ot '~^\x). Hence, in solving Eq (9.7.14) we can take 
c_i = 0. Also, since Pq~ ol ~^\x) = 1, it can be seen from Eqs (9.7.20) and 
(9.7.21) that the first equation obtained from (9.7.20) for m = 0 is equivalent to the 
consistency condition 


/>-/: 


k(x , s)(j)(s ) ds 


ds 

w(s) 


Thus, Eqs (9.7.20) give (N + 1) linear equations to compute the unknown constants 

c 0 ,... , c^. 

Case 2. ft = 0: This case does not need any additional conditions, and Eqs 
(9.7.20) give the unique solution for Co,... , cat. 

Case 3. ft = 1: In this case there are (N + 2) unknown constants Co, • • • , cat+i 
but only ( N+ 1) equations given by (9.7.20). Thus, we need one more equation, which 

is provided by the equilibrium or compatibility condition J cj)(s) ds = A, which, 

after its substitution into (9.7.15) and using the orthogonality condition, reduces to 


c 0 0o{a,(3) = A. 

Then Eqs (9.7.20) together with this condition are solved to compute the (N + 2) 
constants cq, ... , cat+i- 


9.8. Canonical Equation 

The CSK1 of the form (9.6.2) on the interval [—1,1] is given by 

— -f + A [ k(x, s)cj)(s ) ds = f(x), \x\ < 1. 

7 r 7-i s — x 7-i 

If A = 0, we obtain the so-called canonical equation 

1 f 1 </>(s)ds 
n J-i 


s — x 


= f(x), |x| < 1, 


which has a bounded solution iff 

1 f 1 f(x) dx 


£ 


-i vi — ■ 


= o. 


(9.8.1) 


(9.8.2) 


(9.8.3) 
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If Eq (9.8.2) has bounded solution, then 



k(x, s)&(s) ds} dx 


= 0 . 


Since this equation contains </>(s), it cannot be used to check whether the necessity 

’ dx = 0 for almost all s. But this 
-l yl — % 2 

is obviously the case when k(x, s) is an odd function of x. 


The collocation method given above to compute a bounded solution of Eq (9.8.2) 
consists of the following steps: 

1. Set(j)(x) = \/l — x 2 g(x); 

2. Replace the integrals by the Gaussian quadrature using the zeros of U n (x ); 

3. Generate the system of linear algebraic equations at the zeros of T n+ i (x ); and 

4. Solve this system, which contains (n + 1) equations in n unknowns; thus ignore 
one equation. 


Jen and Srivastav (1983, p. 626) observe that “in practice the most harmless point 
to neglect would be the one closest to x = 0.” Note that in steps 2 and 3 we use the 
nodes and Nystrom points, given by 


Nodes: Sn = cos (— -7rV j = 1,.... n. 

3 V 2 n) 

( i 7T \ 

— J , i = 1 , 2 ,... , n — 1, 

and the quadrature given by 

\/l- s 2 g(s)ds _ 1 2 yt L (l ~ Sj) g(sj) 

Sj — Xn 2n + 2 ^ Sj — Xo 

j j =1 j 



(9.8.4) 


Also, by a change of variable it is easy to verify that in the equation 


f 1 y/l - s 2 g(s) ds _ 

J- 1 Sj-Xi 


N < i, 


(9.8.5) 


g(s) is an odd function of 8 if f {x) is even, and g{s) is an even function of s if f{x) 
is odd. Hence, to solve Eq (9.8.2), first we split it into its ‘odd’ and ‘even’ parts, 
and then combine the regular part of Eq (9.8.2) with f(x). Now, we consider the 
following two cases: 


Case 1. If f(x) is odd and g(s) is even, then a bounded solution always exists 
because the condition (9.8.3) is automatically satisfied. By using Gauss-Chebyshev 
rule (§3.2.7), Eq (9.8.5) reduces to 


1 

2 Tl -\- 1 


t 1 — gf) 9(sj) ds 

h[ s i ~ x * 


f (xi ), i = 1 ,... , 2n + 1 , 
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which, by using symmetry, can be written as 


2 n - 


E 

3 =1 


(l-s|) g { Sj ) ds 


s*-xj 


= Xif ( Xi ) , 


i = 1 ,... ,n + l. 


The equation corresponding to i = n + 1 is automatically satisfied since x n +\ = 0. 
Hence, there are n equations in n unknowns g (+■), and the system is normal. 

Case 2. If g ( s ) is odd, f { pc ) is even and the condition (9.8.3) is satisfied, where 

2n+2 

the discrete form of this condition is f (% i ) = 0, which, since f ( x ) is even and 

i =1 

the distribution of the points Xi are symmetric, reduces to 


71+1 


E/(^) = 0 ’ 


(9.8.6) 


7=1 


then formula (9.8.4) yields the following system of linear algebraic equations: 
1 


2n + 2 ^ 

3 = 1 


(l — s ?) g ( Sj ) ds 

E-- ^ = /+), * = l,...,2n + 2. (9.8.7) 

^' G • - 9* • 


This system is overdetermined but consistent (see Jen and Srivastav 1983, p.629). 
Notice that s n+ 1 = 0, and for continuous g we have g (s n +i) = 0- Hence, the 
system (9.8.7) reduces to 


71+1 


E 

3 = 1 


s j (! - s j) 9 ( Sj ) ds 


q2 _ ™2 

Sj x i 


= f(xi) , i = • ,7i + l, 


(9.8.8) 


which has n + 1 equations and n unknowns g ( sj ). This system can be written in 
matrix form as 


Ag = f, 


(9.8.9) 


where A = (<+,j) is an (n + 1) x n matrix with its (i, j)-th element given by 


1 + 1 + 

71+1 SJ - Xf 


an 


g = {gj} is an n x 1 vector with the j-th element and f = {/^} is 

(n + 1) x 1 vector with the z-th element f ( xi ). 

Now, a least squares solution of system (9.8.9) is obtained as follows: Introduce 
a ‘phantom’ variable g (s n +i) that satisfies 


1 X+ s 2 j (l - sf) g ( Sj ) /Sj ds 


tE 

j=i 


Sj - xf 


+ 9 (s n +i) = f (Xi), i = l,...,n+l, 

(9.8.10) 


2005 by Chapman & Hall/CRC Press 













9.8. CANONICAL EQUATION 


497 


and consider the system 

(Ae) g = f, (9.8.11) 

where e = [l, 1 ,... , l] \ and g is the vector g augmented by the element g (s n+ i); 

n 

thus, g is an (n + 1) x 1 vector. By using the identity ( s j - x f) = 0 , for 

j=i 

i = 1,... ,n — 1, where sj are the zeros of the polynomial T 2n (x) and Xi the 
zeros of the polynomial U 2n -i(%)> the columns of the coefficient matrix in (9.8.11) 
form an orthogonal basis in lZ n+1 . The condition (9.8.6) implies that the vector f is 
orthogonal to e, i.e., g (s n +i) = 0. Assuming that / satisfies the condition (9.8.3) 
but not (9.8.6), we find that the least-squares solution g* = {p*}, j = 1 ,... , n, of 
the system (9.8.9) satisfies the system 

A t Ag* = A t f, (9.8.12) 


which is a normal system. Since the columns of A are mutually orthogonal, we find 
that 


1 




n + 1 


71+1 

E 


/+) 

=2 _ ~2 


j = !,••• ,n. 


(9.8.13) 


Note that the least-squares solution g* coincides with the phantom solution g in the 

1 n +1 

sense that gj = g* for j = 1,... , n, and g n +i = - / (x^). The quantity 

Ti 1 . 

7 = 1 

l n+1 

d = -- V f (xi), which defines the accuracy of the Gaussian quadrature, can 

+ 1 2=1 

be used as a measure of inconsistency. We consider the case where d differs 
significantly from zero for moderately large n, and solve the overdetermined system 
(9.8.9) by deleting one row from the matrix A. The question is, which row should 
be deleted. Suppose that g (p) is the solution vector of the system 


A>) g b) =&\ (9.8.14) 

where A^ and are obtained from the original system (9.8.9) by deleting the p-th 

row. Define an n x 1 vector by = g* — g^, and an n x 1 vector d by dj , 
j = 1,... , n. Then satisfies the system 

A (p) 6 (p) =d (p). (9.8.15) 


Instead of solving (9.8.15) directly, we use the properties of the matrix A to compute 
as follows: Define an (n + 1) x 1 vector d* by d* = d, j = 1,... , n + 1, j p, 
and d* = — nd , and consider the augmented system 

(Ae) 6 = d*, (9.8.16) 
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where e is augmented by a ‘phantom’ element e n+ i. Since the right side of vector 
d* satisfies the consistency condition (9.8.6), we find by using the orthogonality 
properties of the coefficient matrix that 

4 p) =-d 2 — 2 , j = 1,... ,n; p = 1 ,... ,n + 1, (9.8.17) 


determines the discrepancy in the j-th element of the solution vector caused by 
deleting the p-th row of the system. The error in g(s) is, therefore, determined 
by 




(9.8.18) 


Jen and Srivastav (1983) compute for n = 20, d = 1, and p = 1, 7,14,18,21, 
and observe that the error is maximum near the deleted row. They advise that the 
choice of the row to be deleted must depend on the quantity of interest in the problem; 
e.g., in crack problems if the stress near the endpoints needs be computed, then choose 
the deleted value of Sj which is closest to zero. But if we seek the entire crack profile 
and maximum crack displacement, then choose the deleted value Sj which is farthest 
from zero. 


Example 9.8.1. (Jen and Srivastav 1983) Consider the canonical equation 


/' !^EE ds = 

J- 1 S-X 


l — a 2 

1 — 2 ax + a 2 


- 1 , 


\x\ < 1 , 


with a 2 = 


/ 


/ofo) 

-1 y/l-X 


0.95. Let fo(x) denote the even part of the right side f(x). Then 
= dx = 0, and the compatibility condition is satisfied. Thus, the exact 


solution is given by the odd part (case 2), i.e.,g(x) = - 77 . Tables 9.8.1(a) 

1 — 2 ax + a 1 

and 9.8.1(b) give the numerical solutions obtained by Jen and Srivastav (1983) with 
n = 20 and n = 60, respectively, and show the deleted row of the overdetermined 
system. Note that the discrepancy between the exact and computed values depends 
only on the value of d chosen, and not on the solution itself. Columns 2 and 3 give 
the exact values and the values obtained by the least-squares method, respectively, 
and the last three columns give the values of e* (s) for different values of p. 


9.9. Finite-Part Singular Equations 

We apply the product integration method to equations of the form 

4>(x) = f(x)+ =£ , X ' 1 S } 4>(s) ds , a < x < b, a > 1, (9.9.1) 

Ja (x-s) a 
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where the integration is in the finite-part or Hadamard sense (see §5.4.3; also Davis 
and Rabinowitz 1984, pp. 11-13). Equations of the above form are strongly singular 
and are encountered in fracture mechanics, gas radiation, and fluid flow (Kaya and 
Erdogan 1987). 

Table 9.8.1(a). For n = 20, d = -0.2079 


s 

9{s) 

9(s) 

p = 21 

p =10 

p = 1 

0.9972 

-11.9377 

-9.4564 

-0.0156 

-0.0369 

3.7 

0.9749 

-4.3238 

-3.4251 

-0.0475 

-0.1200 

0.9372 

0.9309 

-2.5355 

-2.0084 

-0.0817 

-0.2421 

0.5352 

0.8660 

-1.7275 

-1.3684 

-0.1202 

-0.5129 

0.3620 

0.7818 

-1.2518 

-0.9916 

-0.1661 

-2.7579 

0.2247 

0.6801 

-0.9267 

-0.7341 

-0.2247 

0.9263 

0.1661 

0.5633 

-0.6811 

-0.5296 

-0.3062 

0.3762 

0.1202 

0.4339 

-0.4812 

-0.3812 

-0.4349 

0.2104 

0.0817 

0.2948 

-0.3082 

-0.2442 

-0.6849 

0.1201 

0.0475 

0.1490 

-0.1506 

-0.1193 

-1.4717 

0.0555 

0.0156 

0.0 

0.0 

0.0 

— 

— 

— 


Table 9.8.1(b). For n 

= 60, d = - 

-0.0038 


s 

9(s) 

9{s) 

p = 61 

^3 

II 

OO 

0 

p = 1 

0.9937 

-19.4869 

-19.4121 

-0.0001 

-0.0002 

0.1984 

0.9838 

-5.3774 

-5.3568 

-0.0007 

-0.0015 

0.0211 

0.9449 

-2.8574 

-2.8464 

-0.0013 

-0.0032 

0.0110 

0.8827 

-1.8726 

-1.8654 

-0.0020 

-0.0063 

0.0072 

0.7998 

-1.3302 

-1.3251 

-0.0029 

-0.0161 

0.0051 

0.6979 

-0.9733 

-0.9696 

-0.0039 

0.0496 

0.0037 

0.5794 

-0.7102 

-0.7075 

-0.0054 

0.0095 

0.0017 

0.4471 

-0.4994 

-0.4975 

-0.0077 

0.0047 

0.0019 

0.3041 

-0.3190 

-0.3178 

-0.0120 

0.0025 

0.0012 

0.1539 

-0.1556 

-0.1550 

-0.0248 

0.0012 

0.0006 

0.0 

0.0 

-0.0038 

— 

— 

— ■ 


As before, we partition the interval [a, b] into n parts by a = si < S 2 < ... < 
s n+ 1 = b. On the subinterval [sj, Sj+2] we interpolate k(x, s)(j)(s ) by a quadratic 
polynomial. Then we use Nystrom method by taking x = s$, i = 1,... ,n + 1, 

n 

and approximate the integral by a sum of the form Wij(x)k (si, Sj) (sj), as in 

3 = 1 
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In 


2 

- x 

n 


(9.3.2), where in this case the weights Wij are given by (see Bertram and Ruehr 1992) 

1 2 / 3 \ 

w i0 = 2n - - + n (a - — J 

w i, 2 j = 4n + 3n In 

IL 

9.n - 3 \ 

In 


x 


— n [x — 


i a 


2 ( 2j + 3^ 
+ n [x -J 


n 




J-2 


— X 


n 


Wiflj+I = —4n + 2n 2 (x — In 

t + “ 2 ( ; 


x — ' 


3 ~ 1 


n 


x — 


J + l 


n 


w%.n — 


2n — 3> 
2 n > 


In - 


, j = 1 ,... ,n- 1 , 

, j = 1 ,... ,n- 1 , 
|l — x\ 


n — 2 


This leads to a linear (2n—1) x (2n—1) system that can be solved to yield approximate 
values </> at S2? • • • , s n . 


Example 9.9.1. (Bertram and Ruehr 1992) We shall consider the case when 

a = 2. Then p(x, s) = ? an( j w ith a = 0, b = 1 Eq (9.9.1) becomes 

(x — s) z 

4>(x) = f(x)+ =f - ^ S \ 2 ds ■ (9.9.2) 

Jo ( x-sy 

Table 5.4.5 gives the Hadamard transform #2^] defined by 

H 2[4>\= £ ( 9 - 9 - 3 ) 

for functions <j)(x) that exhibit different types of singularities, as in (l)-(3) where 
4>(x) = x@(l — x) 1 for rational /3 and 7 ; in (4) internal (jump) singularities; in 
(5)-(6) singularities (jump) in the first derivative, and those in (7) in the second 
derivative; we have also included a smooth function <p(x) = sin 7 tx in (8). Note that 
in the finite-part (Hadamard) sense the infinite values of poles and logarithms should 
be discarded in the second column of this table, and according to a convention in 
finite-part interpretation we take ln(0) = 0. 

Let / = (j) — H 2 [4 >\. Then we can determine the error for any approximate solution 
</>. Bertram and Ruehr (1992) have postulated that for sufficiently large n the error at 
the n-th approximation is given by 

e n = \<j){x) - 4>n(x )I = — + + o (^+2 ), (9.9.4) 

where n is the number of subintervals of [a, b] used in the above method. ■ 

For examples of Hadamard’s finite-part integrals, see §5.4.3 and §5.4.4. 
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9.10. Integral Equations over a Contour 

Linear equations FK1 are not always in the form (9.1.1). Sometimes the integral in 
the equation appears as a contour integral where the free variable lies on a contour C. 
However, such equations can be transformed to the form (9.1.1) after parametrizing 
the contour C by the arc length measured from a fixed point on C. If C is a closed 
contour, the integrand k(x,s)<j)(s) becomes periodic with a period equal to the length 
of C. Then the trapezoidal rule yields high-order local truncation errors if k(x , s) 
and <p(x) are smooth. 

Example 9.10.1. Consider an FK1 with a weakly singular kernel 



where z and ( are complex and the contour C is a circle with center at z = 0 and 
radius r. Such equations arise in conformal mappings (see Kythe 1998). Take a point 
P on the contour C as £ = re 10 , where 0 is the angle that the radius vector OP makes 
with the real axis. Thus, |d£| = r\d6\ = rd6. Let z = re 7/6 , where r is fixed and 6 
is the free variable, 0 < 6 < 27r, be a point on C. Then 



? 0 ) <fi (re 10 ) dO = f (re 10 ) . 


This example, though an FK1, illustrates the formulation on integral equations, which 
generally involves contour integration. ■ 

Example 9.10.2. Consider integral equations that involve integration on a 
contour C (closed or unclosed), which have the form 



(9.10.1) 


A method for solving this equation consists of choosing points so, si,... , s n on C 
(note that s n = s G if C is closed) and denoting the arc joining the points Sj, Sj +1 by 
Cj, with length hj = |<Sj+i — Sj |. Then Eq (9.10.1) in the case of a closed contour 
C can be written as 



72 — 1 


(9.10.2) 


Let Zj be a point on Cj. Then we seek to determine the values (j)(z m ), m = 
0,1 ,... ,n, such that 
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But it may be difficult to compute f c k (z m ,a) da, even when C is a line segment 
[a, b\. Therefore, if m ^ j, we will apply the quadrature rule 



(9.10.4) 


to compute the integral on the left side over those points of Cj that do not contain the 
point z m (in this case the integrand remains bounded). For the case when m = j we 
need some method to avoid unbounded quantities (singularities). One such method 
to solve Symm’s equation (Symm 1966) involves an approximate solution for the 
integral f c log jz m — a\ da by using Simpson’s rule: 


L 


log I z m - a\ \da\ 
h 


= < 


Y ( log \z m - Sj I + 4 log \z m - Zj | + log | z m - s j+ 11) if TO ^ j, 

— I { log Uj — I — l} 

+ log \zj - z j+ 11 ( log \zj - s j+1 1 - l| if m = j, 

(9.10.5) 

where Zj is the middle point of Cj. For more information on Symm’s equation, 
and other equations of conformal mappings including Lichtenstein’s, Gershgorin’s, 
Carrier’s, Bannin’s, Waeschawski-Stiefel’s, Theodorsen’s, Arbenz’, and Mikhlin’s 
equation, see Trefethen (1986) and Kythe (1998). ■ 


9.5.1. Boundary Element Method. There are many books on this subject; 
for example, the book by Kythe (1995) on this subject is a good source for the 
description of the method as well as computer codes. A summary of this method 
together with computer codes is available in the directory bem. pdf on the CD-R. 
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Quadrature Tables 


Various tables used in quadrature rules are presented. 


Table A.l. Cotesian Numbers, Tabulated for k <n/2,n = 1(1)11. 


n 

rm 

°0 

cf 

c? 

c 3 ” 

Q 

c% 

1 

1 

2 






2 

1 

6 

4 

6 





3 

1 

8 

3 

8 





4 

7 

32 

12 




90 

90 

90 




5 

19 

75 

50 




288 

288 

288 




6 

41 

216 

27 

272 



840 

840 

840 

840 



7 

751 

3577 

928 

10496 



17280 

17280 

17280 

17280 



8 

989 

5888 

1323 

2989 

4540 


28350 

28350 

28350 

28350 

28350 


9 

2857 

315741 

1080 

19344 

5778 


89600 

89600 

89600 

89600 

89600 


10 

16067 

598752 

106300 

598752 

48525 

598752 

272400 

598752 

260550 

598752 

427368 

598752 

11 

2171465 

87091200 

13486539 

87091200 

3237113 

87091200 

25226685 

87091200 

9595542 

87091200 

15493566 

87091200 
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Table A.2. Weights for a Single Trapezoidal Rule and Repeated Simpson’s Rule.* 


m \j 

0 

1 

2 

3 

4 5 

1 

ft/ 2 

ft/2 




2 

ft/3 

4ft/3 

ft/3 



3 

ft/2 

5ft/6 

4ft/3 

ft/3 


4 

ft/3 

4ft/3 

2ft/3 

4ft/3 

ft/3 

5 

ft/2 

5ft/6 

4ft/3 

2ft/3 

4ft/3 ft/3 


Table A.3. Weights for Repeated Simpson’s Rule and a Single Trapezoidal Rule. 


m \i 

0 

1 

2 

3 

4 5 

1 

ft/2 

ft/2 




2 

ft/3 

4ft/3 

ft/3 



3 

ft/3 

4ft/3 

5ft/6 

ft/2 


4 

ft/3 

4ft/3 

2ft/3 

4ft/3 

ft/3 

5 

ft/3 

4ft/3 

2ft/3 

4ft/3 

5ft/6 ft/2 


Table A.4. Weights for a Single 3/8-Rule and Repeated Simpson’s Rule. 


m \j 

0 

1 

2 

3 

4 

5 6 

1 

ft/2 

ft/2 





2 

ft/3 

4ft/3 

ft/3 




3 

3ft/8 

9ft/8 

9ft/8 

3ft/8 



4 

ft/3 

4ft/3 

2ft/3 

4ft/3 

ft/3 


5 

3ft/8 

9ft/8 

9ft/8 

17ft/24 

4ft/3 

ft/3 

6 

ft/3 

4ft/3 

2ft/3 

4ft/3 

2ft/3 

4ft/3 ft/3 


* Trapezoidal rule is used for integral f Q 
integral. 


and Simpson’s rule for the remainder of the 
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Table A.5. Weights for Repeated Simpson’s Rule and a Single 3/8-Rule. 


m\j 0 1 2 


1 

h/2 

h/2 


2 

h/3 

Ah/3 

h/ 3 

3 

3h/8 

9h/8 

9h/8 

4 

h/ 3 

Ah/ 3 

2h/3 

5* 

h/ 3 

Ah/3 

Ylh/2A 

6 

h/ 3 

Ah/ 3 

2h/3 

7* 

h/ 3 

Ah/3 

2h/3 


3 

4 

5 

6 7 

3/i/8 
Ah/3 
9h/8 

h/3 

9h/8 

3h/8 


Ah/3 

2h/3 

Ah/ 3 

h/3 

Ah/ 3 

17/i/24 

9h/8 

9h/8 3h/8 


The asterisk (*) indicates values that differ from corresponding values in Table A.l. 
The above table has practical advantages over Table A. 1. 


Table A.6. Gauss-Legendre Quadrature. 

l n 

w(x) = 1, J_ a /( x) dxtt 52 w k f (x k ). 

k d 


n 

Nodes 

Weights Wk 

2 

0.57735 0269189626 

1 . 

3 

0 . 

0.774596669241483 

0.88888 88888 88889 
0.55555 55555 55556 

4 

0.3399810435 84856 
0.8611363115 94053 

0.65214 51548 62546 
0.34785 4845137454 

5 

0 . 

0.53846 9310105683 
0.9061798459 38664 

0.56888 88888 88889 
0.47862 86704 99366 
0.23692 68850 56189 

6 

0.2386191860 83197 
0.66120 93864 66265 
0.93246 95142 03152 

0.4679139345 72691 
0.36076 1573048139 
0.17132 44923 79170 

7 

0 . 

0.40484 51513 77397 
0.7415311855 00394 
0.94910 7912342759 

0.41795 91836 73469 
0.38183 00505 05119 
0.27970 53914 89277 
0.12948 4966168870 

8 

0.1834346424 95650 
0.52553 2409916329 
0.79666 6477413627 
0.96028 98564 97536 

0.36268 37833 78362 
0.31370 66458 77887 
0.22238 10344 53374 
0.10122 85362 90376 


Continued 
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Table A.6. Gauss-Legendre Quadrature, Continued. 


w(x) = 1, fl 1 f{x) dx 


n 

E w kf (x k ). 


k=1 


n 

Nodes ±Xk 

Weights Wk 

9 

0 . 

0.32425 3423403809 
0.613371432700590 
0.8360311073 26636 
0.96816 02395 07626 

0.33023 93550 01260 
0.31234 70770 40003 
0.2606106964 02935 
0.18064 81606 94857 
0.0812743883 61574 

10 

0.148874338981631 
0.43389 5394129247 
0.67940 95682 99024 
0.86506 33666 88985 
0.97390 6528517172 

0.29552 4224714753 
0.26926 67193 09996 
0.21908 6362515982 
0.149451349150581 
0.0666713443 08688 

16 

0.0950125098 37637 
0.28160 35507 79259 
0.4580167776 57227 
0.617876244402644 
0.755404408355003 
0.865631202387832 
0.9445750230 73233 

0.18945 06104 55068 
0.18260 34150 44924 
0.16915 65193 95003 
0.14959 5988816577 
0.12462 89712 55534 
0.09515 85116 82493 
0.06225 35239 38648 
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Table A.7. Gauss-Laguerre Quadrature. 


fo f ( x ) Inzdz 


n 

E w k f(x k ). 


k= 1 


n 

Nodes ±Xk 

Weights Wk 

2 

0.58578 64376 27 
3.4142135623 73 

8.53553 390593(-01) 
1.46446 609407(—01) 

4 

0.4157745567 83 
2.29428 03602 79 
6.28994 50829 37 

7.11093 009929(-01) 
2.78517 733569(-01) 
1.03892 565016(-02) 

8 

0.32254 7689619 
1.745761101158 
4.53662 02969 21 
9.395070912301 

6.03154104342(-01) 
3.57418 692438(-01) 
3.88879 085150(-02) 
5.39294 705561 (-04) 

10 

0.26356 0319718 
1.41340 3059107 
3.59642 5771041 
7.0858100058 59 
12.64080 08442 76 
0.22284 6604179 
1.18893 21016 73 
2.99273 63260 59 
5.775143569105 
9.83746 7418383 
15.9828739806 02 

5.21755 610583(-01) 
3.98666 811083(-01) 
7.59424 496817(-02) 
3.61175 867992(-03) 
2.33699 723858(—05) 
4.58964 673950(-01) 
4.17000 830772(-01) 
1.13373 382074(-01) 
1.03991974531 (-02) 
2.61017202815(-04) 
8.98547 906430(-07) 
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Table A. 8 . Gauss-Hermite Quadrature. 

W (x) = e~ x \ /A 3 e ~ x2 fix) dx^ jr w k f (x k ). 

k =1 


n 

Nodes ±Xk 

Weights Wk 

T 2 

Wk e k 

2 

0.70710 6781186548 

8.86226 92545 28(-01) 

1.4611411826 611 

3 

0 . 

1.2247448713 91589 

1.18163 59006 04(+00) 
2.95408 97515 09(-01) 

1.18163 59006 037 
1.3239311752136 

4 

0.52464 76232 75290 
1.65068 01238 85785 

8.0491409000 55(-01) 
8.13128 35447 25(-02) 

1.05996 44828 950 
1.24022 58176 958 

5 

0 . 

0.958572464613819 
2.02018 28704 56086 

9.45308 72048 29(-01) 
3.93619 32315 22(-01) 
1.99532 42059 05(-02) 

0.94530 87204 829 
0.98658 09967514 
1.18148 86255 360 

6 

0.43607 74119 27617 
1.33584 9074013697 
2.3506049736 74492 

7.24629 59522 44(-01) 
1.57067 32032 29(-01) 
4.53000 99055 09(-03) 

0.8764013344 362 
0.93558 05576 312 
1.13690 83326 745 

7 

0 . 

0.81628 78828 58965 
1.673551628767471 
2.6519613568 35233 

8.10264 61755 68(-01) 
4.256072526101(-01) 
5.45155 8281913(-02) 
9.7178124509 95(-04) 

0.8102646115 568 
0.82868 73032 836 
0.8971846002 252 
1.10133 07296103 

8 

0.38118 69902 07322 
1.15719 3712446780 
1.98165 67566 95843 
2.93063 74202 57244 

6.6114701255 82(-01) 
2.07802 3258149(-01) 
1.70779 83007 41(-02) 
1.996040722114(-04) 

0.7645441286 517 
0.79289 00483 864 
0.86675 26065 634 
1.07193 01442 480 

9 

0 . 

0.723551018752838 
1.46855 3289216668 
2.26658 05845 31843 
3.19099 3201781528 

7.20235 21560 61(-01) 
4.3265155900 26(-01) 
8.84745 27394 38(-02) 
4.94362 42755 37(-03) 
3.96069 77263 26(-05) 

0.72023 52156 061 
0.73030 24527451 
0.76460 81250 946 
0.84175 27014 787 
1.04700 35809 767 

10 

0.3429013272 23705 
1.036610829789514 
1.75668 36492 99882 
2.5327316742 32790 
3.43615 91188 37738 

6.10862 63373 53(-01) 
2.40138 61108 23(-01) 
3.38743 94455 48(-02) 
1.34364 57467 81(-03) 
7.64043 28552 33(-06) 

0.6870818539 513 
0.70329 63231049 
0.7414419319436 
0.82066 61264048 
1.0254516913 657 


Continued 
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Table A. 8. Gauss-Hermite Quadrature, Continued. 


n Nodes ±Xk Weights Wk 


Wk e Xk 


12 


16 


0.3142403762 54359 
0.94778 83912 40164 
1.59768 2635152605 
2.27950 70505 01060 
3.02063 7025120890 
3.88972 48z78 69782 


0.27348 10461 3815 
0.82295 144914466 
1.38025 853919888 
1.95178 799091625 
2.54620 215784748 
3.17699 91619 7996 
3.86944 79048 6012 
4.68873 893930582 


5.70135 23626 25(-01) 
2.60492 31026 42(-01) 
5.16079 85615 88(-02) 
3.90539 05846 29(-03) 
8.57368 70435 88(-05) 
2.6585516843 56(-07) 


5.07929 47901 66(-01) 
2.80647 45852 85(-01) 
8.3810041398 99(-02) 
1.2880311535 51(-02) 
9.32284 00862 42(-04) 
2.71186 00925 38(-05) 
2.32098 08448 65(-07) 
2.65480 74740 11 (-10) 


0.62930 78743 695 
0.6396212320 203 
0.66266 27732 669 
0.70522 03661122 
0.78664 39394 633 
0.98969 90470 923 


0.5473752050 378 
0.5524419573 675 
0.5632178290 882 
0.58124 72754009 
0.60973 69582 560 
0.65575 56728 761 
0.73824 56222 777 
0.9368744928 841 
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Table A.9. Gauss-Radau Quadrature. 


/ I n 

f (x) dx ps W\ f(-l) + Y^ Wk f (%k) , — 1 < < 1, where each free node 

_1 k =2 

Xk is the fc-th root of f( 2n -i) fc = 2 ,... , n, and xi = —1 

[(2n — 1) !J^ 

and = 2/n 2 . 


n 

Nodes 

Weights Wk 

3 

0.28989 79485 

1.0249716523 


0.68989 79485 

0.75280 61254 

4 

-0.57531 89235 

0.65768 86399 


0.18106 62711 

0.77638 69376 


0.82282 40809 

0.44092 44223 

5 

-0.72048 02713 

0.44620 78021 


-0.16718 08647 

0.62365 30459 


0.4463139727 

0.56271 20302 


0.8857916077 

0.28742 71215 

6 

-0.80292 98284 

0.31964 07532 


-0.39092 85467 

0.48538 71884 


0.12405 03795 

0.52092 67831 


0.60397 31642 

0.41690 13343 


0.92038 02858 

0.20158 83852 

7 

-0.85389 13426 

0.23922 74892 


-0.53846 77240 

0.38094 98736 


-0.11734 30375 

0.44710 98290 


0.3260306194 

0.42740 37790 


0.70384 28006 

0.3182042314 


0.94136 71456 

0.14898 84711 

8 

-0.88747 78789 

0.18535 81548 


-0.6395186165 

0.30413 06206 


-0.29475 05657 

0.37651 75453 


0.09430 72526 

0.39157 21674 


0.46842 03544 

0.3470147956 


0.7706418936 

0.24964 79013 


0.9550412271 

0.11450 88147 


Continued 
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Table A.9. Gauss-Radau Quadrature, Continued. 


9 -0.01073 20894 0.1476540190 

-0.71126 74859 0.24718 93782 

-0.42635 04857 0.31684 37756 

-0.09037 33696 0.34827 30027 

0.25613 56708 0.33769 39669 

0.57138 30412 0.28638 66903 

0.81735 27842 0.20055 32980 

0.96444 01697 0.0907145049 

10 -0.9274843742 0.12029 66705 

-0.76384 20424 0.20427 01318 

-0.52564 60303 0.26819 48378 

-0.23623 44693 0.30585 92877 

0.07605 91978 0.31358 24572 

0.38066 48401 0.2906101648 

0.64776 66976 0.23919 34317 

0.85122 52205 0.16437 60127 

0.97117 51807 0.07361 70054 
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Table A. 10. Gauss-Lobatto Quadrature. 


/ I n 

f(x) dx ps W\ /(- 1 ) + w n /( 1 ) + ^2 W k f (x k ) 

n ( n ~ l) 3 2 2n_1 [(n — 2)!] 4 j.(2n-2)//-\ i ^ ^ 

(2n — 1 ) [(2n — 2)!] 3 J 4 

2 

Xfe is the (k — l)-st root of P^ l _ 1 (x) and Wk = -2 

n(n - l)P n -i (x k )) 

2 ,... , n — 1; xi = —1, x n = 1, and w\ = w n = 2/ (n(n — 1)). 


n 

Nodes ±x k 

Weights w k 

3 

1 . 

0.33333 33333 


0 . 

1.33333 33333 

4 

1 . 

0.16666 66667 


0.44721 35954 

0.83333 33333 

5 

1 . 

0.10000 000 


0.65465 36707 

0.5444444444 

6 

1 . 

0.06666 66667 


0.76505 53239 

0.3784749562 


0.2852315164 

0.55485 83770 

7 

1 . 

0.0476190476 


0.83022 38962 

0.27682 60473 


0.4688487934 

0.43174 53812 


0 . 

0.48761 90476 

8 

1 . 

0.0357142857 


0.8717401485 

0.2107042271 


0.59170 01814 

0.34112 26924 


0.20929 92179 

0.41245 87946 

9 

1 . 

0.02777 77778 


0.89975 79954 

0.16549 53616 


0.67718 62795 

0.27453 87126 


0.3631174638 

0.34642 85110 


0 . 

0.3715 192744 

10 

1 . 

0.0222222222 


0.91953 39082 

0.13330 59908 


0.7387738651 

0.22488 93420 


0.47792 49498 

0.29204 26836 


0.1652789577 

0.32753 97612 
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Table A. 11. Nodes of Equal-Weight Chebyshev Rule. 


n 

±Xi 

n 

±Xi 

n 

±Xi 

2 

0.57735 02692 

5 

0.83249 74870 

7 

0.88386 17008 




0.3745414096 


0.52965 67753 




0.00000 00000 


0.3239118105 
0.00000 00000 

3 

0.70710 67812 
0.00000 00000 

6 

0.86624 68181 

9 

0.91158 93077 
0.6010186554 
0.52876 17831 

4 

0.7946544723 


0.42251 86538 


0.16790 61842 


0.18759 24741 


0.26663 54015 


0.00000 00000 


Table A. 12. Gauss-Log Quadrature. 


n 

Nodes ±Xk 

Weights Wk 

2 

0.11200 880616697618296 
0.60227690811873810276 

0.71853 93190 30384 44067 
0.28146 06809 69615 55933 

4 

0.41448 48019 93832 20803(-01) 
0.24527 49143 20602 25194 

0.55616 54535 60275 83718 

0.84898 23945 3298517465 

0.38346 406814513512485 
0.38687 53177 74762 62734 
0.19043 51269 50142 41536 
0.39225 48712 99598 32453(-01) 

8 

0.13320 24416 08924 65012(-01) 
0.79750 4290138949 38410(-01) 
0.19787102932618805379 

0.35415 399435190941967 

0.52945 85752 3491727771 

0.7018145299 39099 96384 

0.84937 93204 41106 67605 

0.95332 64500 56359 78877 

0.1644166047 28002 88683 
0.23752 56100 2330602050 
0.2268419844 3191912637 
0.17575 40790 06070 24499 
0.11292 40302 46759 05186 
0.57872 2107177820 72399(-01) 
0.20979 07374 21329 78043(-01) 
0.36864 07104 0276190134(-02) 


Continued 
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Table A.12. Gauss-Log Quadrature, Continued. 


0.38978 344871159159241(-02) 
0.23028 9456168732 39820(-01) 
0.58280 39830 6240412348(-01) 
0.1086783650 9105403649 
0.17260 94549 09843 93776 
0.24793 70544 70578 49515 
0.33209454912991715598 
0.42218 39105 81948 60012 
0.51508 24733 81462 60348 
0.60755 61204 47728 72409 
0.69637 56532 28214 06116 
0.77843 25658 73265 40520 
0.85085 026971539108323 
0.91108 68572 2227190542 
0.95702 557170354215759 
0.98704 78002 47984 47676 


0.6079171004 35912,32851(-01) 
0.10291567751758214439 
0.12235 566204600919356 
0.12756 92469 37015 98872 
0.123013574600070 91542 
0.11184 72448 55485 72262 
0.96596 38515 21243 41253(-01) 
0.79356 664351473138782(-01) 
0.61850 4945819652 07095(-01) 
0.45435 24650 77266 68629(-01) 
0.31098 9747515818 06409(-01) 
0.19459 76592 73608 42078(-01) 
0.10776 25496 32055 25646(-01) 
0.49725 42890 0876417125(-02) 
0.16782 OHIO 05119 45150(-02) 
0.28235 37646 68436 32178(-03) 
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Table A. 13. Gauss-Kronrod Quadrature Rule. 


n 

Nodes Xi 

Weights Wi for G n (f ) 

Weights Wi for K n (f) 

1 

0.1127016653792582 

0.0 

0.2777777777777777 


0.5 

1.0 

0.4444444444444444 


0.8872983346207418 

0.0 

0.2777777777777777 

2 

0.0370899501137243 

0.0 

0.0989898989898989 


0.2113246854051871 

0.5 

0.2454545454545454 


0.5 

0.0 

0.3111111111111111 


0.7886751345948129 

0.5 

0.2454545454545454 


0.9629100498862757 

0.0 

0.0989898989898989 

3 

0.0197543656459899 

0.0 

0.0528281130132336 


0.1127016653792583 

0.2777777777777777 

0.1342440449341667 


0.2828781253265987 

0.0 

0.2006987073879811 


0.5 

0.4444444444444444 

0.2254582693292372 


0.7171218746734013 

0.00 

0.2006987073879811 


0.8872983346207417 

0.2777777777777777 

0.1342440449341667 


0.9802456843540101 

0.0 

0.0528281130132336 

4 

0.0117198746312134 

0.0 

0.0314886868827365 


0.0694318442029787 

0.1739274225687269 

0.0850268026678614 


0.1798568912518450 

0.0 

0.1333991702261422 


0.3300094782075719 

0.3260725774312781 

0.1634745948007258 


0.5 

0.0 

0.1732214909457258 


0.6699905217924281 

0.3260725774312781 

0.1634745948007258 


0.8201481087481550 

0.0 

0.1333991702261422 


0.9805681557970268 

0.1739274225687269 

0.0850268026678614 


0.9882801253687866 

0.0 

0.0314886868827365 

5 

0.0079573199525788 

0.0000000000000000 

0.0212910183755409 


0.0469100770306680 

0.1184634425280945 

0.0576166583112367 


0.1229166867145754 

0.0 

0.0934008982782463 


0.2307653449471585 

0.2393143352496833 

0.1205201696143238 


0.3601847934191084 

0.0 

0.1364249009562795 


0.5 

0.2844444444444444 

0.1414937089287456 


0.6398152065808916 

0.0 

0.1364249009562795 


0.7692346550528415 

0.2393143352496833 

0.1205201696143238 


0.8770833632854246 

0.0 

0.0934008982782463 


0.9530899229693320 

0.1184634425280945 

0.0576166583112367 


0.9992042680047421 

0.0 

0.0212910183755409 
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Table A. 14. Patterson’s Quadrature Rule. 

1 n 

w(x ) = 1, f_ 1 f(x) dxa YjWkf (x k ). 

k=1 


n 

Nodes ±Xk 

Weights Wk 

3 

0.77459 66692 41483 37704 

0.0 

0.55555 55555 55555 555556 

0.88888 88888 88888 888889 

7 

0.96049 12687 08020 28342 
0.77459 66692 41483 37704 
0.43424 37493 46802 55800 

0.0 

0.10465 62260 26467 265194 

0.26848 80898 68333 440729 

0.40139 74147 75962 222905 

0.45091 65386 58474142345 

15 

0.993831963212755 02221 
0.96049 12687 08020 28342 
0.88845 92328 72256 99889 
0.77459 66692 41483 37704 
0.62110 29467 37226 40294 
0.43424 37493 46802 55800 
0.22338 66864 28966 88163 

0.0 

0.17001 71962 99402 603390(-01) 
0.51603 28299 70797 396969(-01) 
0.929271953151245 376859(-01) 

0.1344152552 43784 220360 

0.171511909136391380787 

0.20062 85293 76989 021034 

0.21915 68584 01587 496404 

0.2255104997 98206 687386 


31 0.99909 81249 67667 59766 

0.993831963212755 02221 
0.9815311495 5374010687 
0.960491268708020 28342 
0.92965 48574 29740 05667 
0.88845 92328 72256 99889 
0.83672 5938168868 73550 
0.77459 66692 41483 37704 
0.70249 62064 91527 07861 
0.62110 29467 37226 40294 
0.5313197436 44375 62397 
0.43424 37493 46802 55800 
0.33113 53932 57976 83309 
0.22338 6686428966 88163 
0.11248 8943133186 62575 
0.0 


0.25447 8079156187 441540(-02) 
0.84345 65739 32110 624631(-02) 
0.16446 0498543878109338(-01) 
0.25807 59809 61766 535646(-01) 
0.3595710330 71293 220968(-01) 
0.46462 8932617579 865414(-01) 
0.56979 50949 41233 574122(-01) 
0.67207 75429 59907 035404(-01) 
0.76879 62049 90035 310427(-01) 
0.85755 92004 99903 511542(-01) 
0.936271099812644 736167(-01) 
0.100314278611795 578771 
0.10566 98935 80234 809744 
0.10957 84210 55924 638237 
0.11195 68730 20953 456880 
0.11275 52567 20768 691607 


Continued 
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Table A. 14. Patterson’s Quadrature Rule, Continued. 


n Nodes ±;c/,. 


Weights Wk 


63 0.99987288812035761194 

0.99909 81249 67667 59766 
0.99720 62593 7222195908 
0.993831963212755 02221 
0.98868 47575 47429 47994 
0.9815311495 5374010687 
0.97218 287474858179658 
0.9604912687 08020 28342 
0.94634 28583 73402 90515 
0.92965 48574 29740 05667 
0.9103711569 57004 29250 
0.88845 92328 72256 99889 
0.86390 7938193690 47715 
0.83672 5938168868 73550 
0.8069405319 5021761186 
0.77459 66692 41483 37704 
0.73975 60443 52694 75868 
0.70249 62064 91527 07861 
0.66290 96600 24780 59546 
0.62110 29467 37226 40294 
0.57719 57100 52045 81484 
0.5313197436 44375 62397 
0.4836180269 4584102756 
0.43424 37493 46802 55800 
0.38335 9324198730 34692 
0.33113 53932 57976 83309 
0.27774 98220 21824 31507 
0.22338 6686428966 88163 
0.16823 52515 52207 46498 
0.11248 8943133186 62575 
0.05634 43130 46592 789972 
0.0 


0.3632214818 45530 659694(-03) 
0.1265156556 23006 801137(-02) 
0.25790 49794 68568 827243(-02) 
0.42176 3044155885 483908(-02) 
0.611550682211724633968(-02) 
0.82230 07957 23592 966926(-02) 
0.10498 24690 96213 218983(-01) 
0.12903 80010 03512 656260(-01) 
0.15406 75046 65594 978021 (-01) 
0.17978 55156 81282 703329(-01) 
0.205942339159127111492(-01) 
0.2323144663 99102 694433(-01) 
0.258696793272147469108(-01) 
0.28489 75474 58335 486125(-01) 
0.310735511116879 648799(-01) 
0.33603 87714 82077 305417(-01) 
0.36064 43278 07825 726401(-01) 
0.38439 81024 94555 320386(-01) 
0.40715 5101169443189339(-01) 
0.42877 96002 50077 344929(-01) 
0.44914 53165 36321974143(-01) 
0.46813 55499 06280124026(-01) 
0.48564 33040 66731987159(-01) 
0.5015713930 58995 374137(-01) 
0.51583 25395 20484 587768(-01) 
0.528349467901165198621(-01) 
0.53905 49933 52660 639269(-01) 
0.54789 21052 79628 650322(-01) 
0.5548140435 65593 639878(-01) 
0.55978 4365104763194076(-01) 
0.56277 6998312543 012726(-01) 
0.56377 62836 03847173877(-01) 


Continued 
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Table A. 14. Patterson’s Quadrature Rule, Continued. 


n Nodes ±xi- 


Weights Wk 


127 0.99998 24303 5489159858 

0.99987 288812035761194 
0.99959 87996 71910 68325 
0.99909 81249 67667 59766 
0.99831663531840739253 
0.99720 62593 7222195908 
0.9957241046 9840718851 
0.993831963212755 02221 
0.99149 572117810613240 
0.98868 47575 47429 47994 
0.9853714995 98520 37111 
0.9815311495 5374010687 
0.9771415146 39705 71416 
0.97218 287474858179658 
0.96663 78515 58416 56709 
0.9604912687 08020 28342 
0.95373000642576113641 
0.94634 28583 73402 90515 
0.93832 03977 79592 88365 
0.92965 48574 29740 05667 
0.92034 00254 70012 42073 
0.91037115695700429250 
0.89974 4899 77694 003664 
0.88845 92328 72256 99889 
0.8765134144 84705 26974 
0.86390 7938193690 47715 
0.85064 44947 68350 27976 
0.83672 5938168868 73550 
0.82215 62543 64980 40737 
0.80694053195021761186 
0.79108 4933799848 36143 
0.77459 66692 41483 37704 
0.75748 39663 80513 63793 
0.73975 60443 52694 75868 
0.72142 30853 70098 91548 


0.50536 09520 78625176247(-04) 
0.18073 9564445388 357820(-03) 
0.37774 66463 26984 660274(-03) 
0.63260 73193 62633 544219(-03) 
0.93836 98485 42381500794(-03) 
0.12895 24082 61041739210(-02) 
0.1681142865 42146 990631(-02) 
0.2108815245 72663 287933(-02) 
0.25687 64943 79402 037313(-02) 
0.305775341017553113613(-02) 
0.35728 92783 51729 964938(-02) 
0.41115 03978 65469 304717(-02) 
0.46710 5037211432174741(-02) 
0.5249123454 80885 912513(-02) 
0.58434 49875 83563 950756(-02) 
0.64519 0005017573 692280(-02) 
0.70724 89995 43355 546805(-02) 
0.77033 75233 27974184817(-02) 
0.83428 38753 968157 70558(-02) 
0.89892 75784 06413 572328(-02) 
0.9641177729 70253 669530(-02) 
0.1029711695 79563 555237(-01) 
0.10955 73338 78379 016480(-01) 
0.11615 7233199551347270(-01) 
0.12275 83056 00827 700870(-01) 
0.12934 83966 36073 734547(-01) 
0.135915710097655467896(-01) 
0.14244 87737 29167 743063(-01) 
0.14893 64166 48151820348(-01) 
0.15536 77555 58439 824399(-01) 
0.16173 21872 95777199419(-01) 
0.168019385741038652709(-01) 
0.1742193015 94641737472(-01) 
0.18032 21639 03912 863201(-01) 
0.1863184825 61387 901863(-01) 


Continued 
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Table A. 14. Patterson’s Quadrature Rule, Continued. 


n Nodes ±;c/,. 


Weights Wk 


0.70249 62064 91527 07861 
0.68298 74310 91079 22809 
0.66290 96600 24780 59546 
0.64227 66425 09759 51377 
0.62110 29467 37226 40294 
0.59940 39302 42242 89297 
0.57719 57100 52045 81484 
0.55449 51326 31932 54887 
0.5313197436 44375 62397 
0.50768 77575 33716 60215 
0.48361802694584102756 
0.4591300119 89832 33287 
0.43424 37493 46802 55800 
0.40897 98212 29888 67241 
0.38335 9324198730 34692 
0.35740 38378 3153215238 
0.33113 53932 57976 83309 
0.30457 64415 56714 04334 
0.27774 98220 21824 31507 
0.25067873030348317661 
0.22338 6686428966 88163 
0.19589 750271110015392 
0.16823 52515 52207 46498 
0.14042423315256017459 
0.11248 8943133186 62575 
0.84454 04008 37108 83710(-01) 
0.56344 31304 65927 89972(-01) 
0.28184 64894 97456 94339(-01) 
0.0 


0.19219 90512 47277 660193(-01) 
0.19795 49504 80974 994880(-01) 
0.20357 75505 84721594669(-01) 
0.20905 85144 58120 238522(-01) 
0.21438 9800125038 672465(-01) 
0.21956 36630 53178 249393(-01) 
0.22457 26582 68160 987071(-01) 
0.22940 96422 93877 487608(-01) 
0.23406 77749 53140 062013(-01) 
0.23854 05210 60385 400804(-01) 
0.2428216520 33365 993580(-01) 
0.24690 5247444876 769091(-01) 
0.25078 56965 29497 687068(-01) 
0.25445 76996 54647 658126(-01) 
0.2579162697 60242 293884(-01) 
0.26115 67337 67060 976805(-01) 
0.26417 47339 50582 599310(-01) 
0.26696 62292 74503 599062(-01) 
0.26952 74966 76330 319634(-01) 
0.27185 51322 96247 918192(-01) 
0.27394 60526 39814 325161(-01) 
0.27579 74956 64818 730349(-01) 
0.27740 70217 82796 819939(-01) 
0.27877 25147 66137 016085(-01) 
0.27989 21825 52381597038(-01) 
0.28076 45579 38172 466068(-01) 
0.28138 8499156271506363(-01) 
0.28176 31903 30166 021307(-01) 
0.28188 81418 01923 586938(-01) 
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Table A. 15. Filon’s Quadrature Formula. 


e 

a 

/? 

7 

0.00 

0.0 

0.66666 667 

1.33333 333 

0.01 

0.00000 004 

0.66668 000 

1.33332 000 

0.02 

0.00000 036 

0.66671999 

1.33328 000 

0.03 

0.00000 120 

0.66678 664 

1.33321334 

0.04 

0.00000 284 

0.66687 990 

1.33312 001 

0.05 

0.00000 555 

0.66699 976 

1.33300 003 

0.06 

0.00000 961 

0.66714617 

1.33285 340 

0.07 

0.00001 524 

0.66731909 

1.33268 012 

0.08 

0.00002 274 

0.66751 844 

1.33248 020 

0.09 

0.00003 237 

0.66774417 

1.33225 365 

0.1 

0.00004438 

0.66799 619 

1.33200 048 

0.2 

0.00035 354 

0.67193 927 

1.32800 761 

0.3 

0.00118467 

0.67836 065 

1.32137184 

0.4 

0.00278 012 

0.68703 909 

1.31212154 

0.5 

0.00536 042 

0.69767347 

1.30029 624 

0.6 

0.00911797 

0.70989111 

1.28594 638 

0.7 

0.01421151 

0.72325 813 

1.26913 302 

0.8 

0.02076156 

0.73729136 

1.24992 752 

0.9 

0.02884 683 

0.75147168 

1.22841118 

1.0 

0.03850 188 

0.70525 831 

1.20467472 


Table A. 16. Gauss-Cos Quadrature on [—7r/2, tt/2] . 


n 

Nodes ±Xk 

Weights Wk 

2 

0.68366 73900 89903 04094 

1.0 

4 

0.43928 74668 6001514756 

0.11906 76563 89485 57415(+01) 

0.77592 93818 72379 83935 
0.22407061812762016065 

8 

0.25649 650741623123020 

0.743468 64787549244989 

0.11537 25645 45672 75850(+01) 
0.144149054018235 75701(+01) 

0.49199 57966 03200 88314 
0.33626 44778 52804 59621 

0.14420 40920 30227 50950 
0.27535 633513767011149(-01) 

16 

0.14003 44442 46967 73778 

0.4157719167 34189 43962 
0.6186110809 7560545347 

0.9202718620 66370 96491 

0.11330 06878 60050 03695(+01) 
0.13091818904452936698(+01) 
0.14446 014873666514608(+01) 
0.15321501132362304719(+01) 

0.2766109576 48260 50408 
0.24763 63209 46355 22403 
0.19741148870253455567 
0.1383419552 69512 73359 
0.83026 64757 32177 42131(-01) 
0.40437 89394 65036 69410(-01) 
0.14115 26815 68540 08264(-01) 
0.24194 67756 76156 28193(-02) 
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Table A.17. Gauss-Cos Quadrature on [0,7r/2]. 


n 

Nodes ±Xk 

Weights Wk 

2 

0.2658738805 63078 23382 

0.1035152609 3171315182(+01) 

0.60362 55328 0827113087 
0.396374467191728 86913 

4 

0.95669 38919 68586 36773(-01) 
0.45240 90232 70670 96554 

0.93185 05767 20240 82424 

0.13564 43959 96664 66230(+01) 

0.237830714195155 04517 
0.40265 69552 35812 53512 
0.2868173794 8564715225 
0.72694 95108 33852 67446(-01) 

8 

0.29023 72976 89139 33432(-01) 
0.14828 52440 4581819442 
0.34531111151664787488 

0.59447 69679 76583 60178 

0.86538 38068 61235 04827 

0.11263 07609 31874 56632(+01) 
0.13470150460281258016(+01) 
0.15015 60362 2059195568(+01) 

0.73908 99809 51173 84985(-01) 
0.16002 99370 23380 06099 
0.21444 4343418035 49108 
0.21979 58126 8851903339 
0.175811644782095 68886 

0.10560 44802 53083 22171 
0.42485 49729 92172 01089(-01) 
0.79192 86440 5519178899(-02) 


16 0.80145 03490 62959 73494(-02) 

0.41893 03135 42462 54797(-01) 
0.10149 95448 67575 79459 
0.1846318592 3836617507 
0.28826 38848 77605 74589 
0.40870 79076 46479 41910 
0.54176 05498 69138 47463 
0.6828763665 8719416893 
0.82729 28762 04168 33520 
0.97018 2125948293 67065 
0.11067 86515 02862 47873(+01) 
0.12325 55569 72277 48824(+01) 
0.13432821921580721861(+01) 
0.14352 37054 92950 32923(+01) 
0.15052 97087 67946 69248(+01) 
0.15510 58694 4086135769(+01) 


0.20528 71497 72152 48902(-01) 
0.46990 91985 35979 58123(-01) 
0.714410213122185 41698(-01) 
0.92350 33832 92430 52271(-01) 
0.1080492802 68162 36935 
0.11698241243306261791 
0.11812 3953617620 37649 
0.11137 58494 04200 91049 
0.97778 23614 59465 43110(-01) 
0.79418 75898 59444 82077(-01) 
0.59039 62005 37686 91402(-01) 
0.39458 87678 3728165671(-01) 
0.22987 78567 72068 47531(-01) 
0.11010 40560 04215 36861(-01) 
0.38123 92803 0499915653(-02) 
0.65143 3754612666 56171(-03) 
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Table A.18. Coefficients in (5.1.15) with w(x) = ln(l/a;), 0 < x < 1. 


71 Ot n f3 n 


0 0.25 

1 0.464285714286 

2 0.485482446456 

3 0.492103081871 

4 0.495028498758 

5 0.496579511644 

6 0.497501301305 

7 0.498094018204 

8 0.498494018204 

9 0.498785322656 

10 0.498997353167 

11 0.499158221678 

12 0.499283180126 

13 0.499382187671 

14 0.499461972097 

15 0.499527212427 

16 0.499581244730 

17 0.499626499806 

18 0.499664782928 

19 0.499697457641 


0.0 

0.486111111111 (—1) 
0.586848072562(—1) 
0.607285839189(—1) 
0.614820201969(—1) 
0.614808095319(—1) 
0.620390629544(—1) 
0.621599191583(—1) 
0.622389376716(—1) 
0.622933886799(—1) 
0.623324775066(—1) 
0.623614734838(—1) 
0.623835683595(—1) 
0.624007864342(—1) 
0.624144615353(—1) 
0.624255013029(—1) 
0.624345406235 (—1) 
0.624420343142(—1) 
0.624483150597(—1) 
0.624536307243(—1) 
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Table A. 19. Coefficients in (5.1.15) with w(x) = Ei(x), 0 < x < oo. 


n 


0n 

0 

0.5 

0.0 

1 

0.23(+l) 

0.416666666667 

2 

0.423469387755(+l) 

0.261333333333(4-1) 

3 

0.619917288995(+1) 

0.675494793836(4-1) 

4 

0.817602876377(+1) 

0.128700101592(4-2) 

5 

0.101592444559(+2) 

0.209689946964(4-2) 

6 

0.121467630339(+2) 

0.310570066309(4-2) 

7 

0.141367011214(4-2) 

0.431369541345(4-2) 

8 

0.161284556528(+2) 

0.572106684370(4-2) 

9 

0.181215390823(4-2) 

0.732793862452(4-2) 

10 

0.201156292899(4-2) 

0.913439870981 (+2) 

11 

0.221105037868(4-2) 

0.111405121907(4-3) 

12 

0.241060033128(4-2) 

0.133463287826(4-3) 

13 

0.261020104696(4-2) 

0.157518874426(4-3) 

14 

0.280984365631(4-2) 

0.183572193521(4-3) 

15 

0.300952131707(4-2) 

0.211623499185(4-3) 

16 

0.320922865502(4-2) 

0.241673001620(4-3) 

17 

0.340896138248(4-2) 

0.273710877032(4-3) 

18 

0.360861603136(4-2) 

0.307767274831 (+3) 

19 

0.380848976220(4-2) 

0.343812322983(4-3) 


Table A.20. 10-point Gauss-Christoffel Rule 


with w(x) = ln(l/x), 0 < x < 1. 

& Ai 


0.904263096219(—2) 

0.120955131955 


0.539712662225(—1) 

0.186363542564 


0.135311824639 

0.195660873278 


0.247052416287 

0.173577142183 


0.380212539609 

0.135695672995 


0.523792317972 

0.936467585381 (—1) 


0.665775205517 

0.557877273514(—1) 


0.794190416012 

0.271598108992(—1) 


0.898161091219 

0.951518260284(—2) 


0.968847988719 

0.163815763360(—2) 
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Table A.21. 20-point Gauss-Christoffel Rule 
with w(x) = ln(l/x), 0 < x < 1. 


& 


0.255832795592(—2) 

0.152096623496(—1) 

0.385365503721(—1) 

0.721816138158(—1) 

0.115460526488 

0.167442856275 

0.226983787260 

0.292754960941 

0.363277429858 

0.436957140091 

0.512122594679 

0.587064044915 

0.661173413315 

0.729484083930 

0.793709671987 

0.851280892789 

0.900879680854 

0.941369749129 

0.971822741075 

0.991538081439 


Xi 


0.431427521332(—1) 

0.753837099086(—1) 
0.930532674517(—1) 
0.101456711850 
0.103201762056 
0.100022549805 
0.932597993003(—1) 
0.840289528792(—1) 
0.732855891300(—1) 
0.618503369137(—1) 
0.504166044385(—1) 
0.395513700052(—1) 
0.296940778958(—1) 
0.211563153554(—1) 
0.141237329390(—1) 
0.866097450433(-2) 
0.471994014620(—2) 
0.215139740396(—2) 
0.719728214653(-3) 
0.120427676330(-3) 


Table A.22. 10-point Gauss-Christoffel Rule 
with w(x) = E\{x), 0 < x < oo. 


Zi 


0.762404872624(—1) 

0.525005762690 

0.143921959617(+1) 

0.286324173848(+1) 

0.484664684765(+1) 
0.745940513320(+1) 
0.108101228402(+2) 
0.150823083551 (+2) 
0.206311914914(+2) 
0.283693946254(+2) 


Ai 


0.485707599602 
0.357347318586 
0.127767083774 
0.263265788641 (—1) 
0.314097760897(—2) 
0.203866802942(—3) 
0.648957008433(—5) 
0.848669062576(-7) 
0.324960593979(—9) 
0.156050745676(—12) 
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Table A.23. 20-point Gauss-Christoffel Rule 
with w(x) = Ei(x), 0 < x < oo. 


& 


0.415731018684(—1) 

0.274239640181 

0.735213024633 

0.143646482057(+1) 

0.238684236390(+l) 

0.359494938617(+1) 

0.507042045480(+l) 

0.682474522008(+l) 

0.887199456612(+1) 

0.112296313102(+2) 

0.139195560950(+2) 

0.169695733188(+2) 

0.204155650908(+2) 

0.243048836079(4-2) 

0.287019535563(4-2) 

0.336981998188(4-2) 

0.394313665944(4-2) 

0.461284475183(4-2) 

0.542229680449(4-2) 

0.648259442473(4-2) 


Ai 


0.330068388136 
0.335018800621 
0.202727089842 
0.906794137819(—1) 
0.311926475044(—1) 
0.830681682460(—2) 
0.170519552143(—2) 
0.267192385286(—3) 
0.315225257509(—4) 
0.275116436420(—5) 
0.173736449646(—6) 
0.771970107104(-8) 
0.232856519853(—9) 
0.454955059531 (—11) 
0.540355193304(—13) 
0.356730027303(—15) 
0.114479498566(-17) 
0.143415823640(—20) 
0.463374056293(—24) 
0.136239857196(—28) 
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Table A.24. Sidi’s Nodes Xk,i for w(x) = (1 — x) a x^ (log x) v . 


k %k,i 


2 0.1504720765483788247340868 (+0) 
0.7384168123405100425671321 (+0) 

3 0.4966471483058575164815096(—1) 
0.3733950309821642554730659(+0) 
0.8425652541872500345121466(+0) 

4 0.1799068499801418849481927(—1) 
0.1834165223808434663776978(+0) 
0.5414157204189523620030400(+0) 
0.8955770722021899610254536(+0) 

5 0.6965462488720096032035478(—2) 
0.9279357371061748571694494(—1) 
0.3274158560864037226245671(+0) 
0.6563187419838211189571098(+0) 
0.9258942258127421665037105(+0) 

6 0.2826962449669843599475705(—2) 
0.4862455152896217464020268(—1) 
0.1976882676470386179801153(+0) 
0.4503451521122742717828658(+0) 
0.7351670962539651466016721 (+0) 
0.9447647096318861903441189(+0) 

7 0.1187258545164058707796495(—2) 
0.2628663472239343296132930(—1) 
0.1210706424838506878316480(+0) 
0.3040908096207194377669225(+0) 
0.5483105637900639317550144(+0) 
0.7906485354805576903913789(+0) 
0.9572768818037840077295186(+0) 

8 0.5115121670143565456995161(—3) 
0.1458573317963311050116104(—1) 
0.7546523540379770911279422(—1) 
0.2056995360684232831971485(+0) 
0.3998834536687977392332982(+0) 
0.6250150234434243001757636(+0) 
0.8308072107358005498056741(+0) 
0.9659870403646759751126183(+0) 


Continued 
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Table A.24. Sidi’s Nodes x kj for w(x) = (1 — x) a x^ (log x) v . Continued. 


k x k ,i 


9 0.2247255954393555916169534(—3) 

0.8269188094627755516996537(—2) 
0.4785186222081606877143400(—1) 
0.1402987492166232474932741(+0) 
0.2900554492782025373109889(+0) 
0.4820003130318437634116435(+0) 
0.6851379193950803969670460(+0) 
0.8606574901008240408017969(+0) 
0.9722887040665427749175365(+0) 

10 0.1002519058889115183838894(—3) 
0.4772351178865461701628092(—2) 
0.3081710497452419192376816(—1) 
0.09668389372266823766910449(+0) 
0.2108292927888059664631726(+0) 
0.3681879873486372245494636(+0) 
0.5510145152797366607799745(+0) 
0.7326572440917100692558961(+0) 
0.8833778455567603549170030(+0) 
0.9769924074477204234412397(+0) 

11 0.4527279518770788580960679(—4) 
0.2795480278297609710164151(—2) 
0.2012015530035912019846123(—1) 
0.6733379444645636036081982(—1) 
0.1540683692211295141571981 (+0) 
0.2806977184599954155963530(+0) 
0.4379750731607002234291315(+0) 
0.6086538380237029866037801 (+0) 
0.7706276021403856146818612(+0) 
0.9010352101154075477040806(+0) 
0.9805950222280231942661999(+0) 

12 0.2064864876175711460486520(—4) 
0.1658119145275128080915805(—2) 
0.1329440070499037472584458(-1) 
0.4736615645452630501965885(—1) 
0.1133435389770539175602337(+0) 
0.2143947425636104353596778(+0) 
0.3465368850551303059326358(+0) 
0.4991909417699800788348341(+0) 
0.6568098047861666843871831 (+0) 
0.8013203430670089444376458(+0) 
0.9150102643845973160452445(+0) 
0.9834146345679861678235056(+0) 
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Table A.25. Nodes for Sidi’s Rule Sk- 


k %k,i 


2 0.3333333333333333148296163(+0) 

0 . 1 (+ 1 ) 

3 0.1078176738977890680715177(+0) 
0.5796823261022109319284823(+0) 
0.2915970806672432691364349(+0) 
0.7182032643371645264096514(+0) 
0 . 1 (+ 1 ) 

5 0.1454539367063958053838402(—1) 
0.1476352319507779342622200(+0) 
0.4492290509129626685513870(+0) 
0.7998557555643852623461498(+0) 
0 . 1 (+ 1 ) 

6 0.5833465496275194034359046(—2) 
0.7697070383625363720891954(—1) 
0.2741621191525560052859589(+0) 
0.5678514494337698614856436(+0) 
0.8511684583089076383544125(+0) 
0 . 1 (+ 1 ) 

7 0.2429255658444682414165428(—2) 
0.4135196615566082145587501 (—1) 
0.1682791497337559616376268(+0) 
0.3890765863668857460488937(+0) 
0.6551717852719092238800158(+0) 
0.8852584870379529569106580(+0) 
0 . 1 (+ 1 ) 

8 0.1040274764820644419829887(—2) 
0.2280766587902437192436622(—1) 
0.1047703618903654126937042(+0) 
0.2647931716598577733812192(+0) 
0.4853839359718086776673829(+0) 
0.7199405641129489330509728(+0) 
0.9089631138816870459251618(+0) 
0 . 1 (+ 1 ) 


Continued 
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Table A.25. Nodes Xk,i for Sidi’s Rule S&, Continued. 


R %n,i 


9 0.4550296440994962016840519(—3) 
0.1286108481364281637404634(—1) 
0.6627059781567289087345074(—1) 
0.1809718441335950167569990(+0) 
0.3548946891567039685355667(+0) 
0.5639126195922897766266146(+0) 
0.7687669484229625593840751(+0) 
0.9260720764210335076427327(+0) 
0 . 1 (+ 1 ) 

10 0.2023447402752151231923594(—3) 
0.7387651749525755116854153(—2) 
0.4255601458052361146799925(—1) 
0.1247171375024214851068294(+0) 
0.2589708071707655934190484(+0) 
0.4345652946896826906986178(+0) 
0.6275259400042944024633584(+0) 
0.8062449296905893625364570(+0) 
0.9388060635967709899318834(+0) 

o.i(+i) 
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Table A.26. Nodes x k ,i for Sidi’s Rule <S/, : . 


k x k ,i 


2 0.1352966685416368830541245(+0) 
1.642481109236140879303889(+0) 

3 0.4505096041273612406108384(—1) 
0.6767167970341259053412841(+0) 
0.3075107242553138053864359(+1) 

4 0.1666747355483805953513254(—1) 
0.3180181842758116328440110(+0) 
0.1552471013121895948572160(+1) 
0.4666443329047454291469421(+1) 

5 0.6575286461353594714973614(—2) 
0.1606142317401454133740657(+0) 
0.8655532227468952788385081(+0) 
0.2654640475454163262014617(+1) 
0.6359556084008965548548531(+1) 

6 0.2707864701816735299860772(—2) 
0.8508305148428640940494461(-1) 
0.5092057433688204071131622(+0) 
0.1639972558714133166191118(+1) 
0.3915248557178793831212715(+1) 
0.8124282662294927348511919(+1) 

7 0.1149791448528518413713106(—2) 
0.4664783979294682969563013(—1) 
0.3106265453447279445420293(+0) 
0.1058211225813305400578201 (+1) 
0.2590541885281939293861342(+1) 
0.5292380339780669906701860(+1) 
0.9942541657663614529383267(+1) 

8 0.4994312298446428261336494(—3) 
0.2624962191042572168253599(—1) 
0.1946430851588193677859095(+0) 
0.7030609671769538771002317(+0) 
0.1779188598644186436459336(+1) 
0.3678545091181902204624521(+1) 
0.6758890871288327772958837(+1) 
0.1180256029366207570774350(+2) 


Continued 
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Table A.26. Nodes x k ,i for Sidi’s Rule Continued. 


k x k ,i 


9 0.2207521317724925791117080(—3) 
0.1507552393251116763794872(—1) 
0.1245393110961793281532550(+0) 
0.4773846078371063450518363(+0) 
0.1252523841360254186483303(+1) 
0.2642940899971808033086518(+1) 
0.4875885820583371277336937(+1) 
0.8296284357470376846777071 (+1) 
0.1369620449461662126111605(+2) 

10 0.9892395934261595503121656(—4) 
0.8801264957863189422604400(—2) 
0.8103177761469819440076634(—1) 
0.3297575418975984273828317(+0) 
0.8980931136795896607694090(+0) 
0.1940497820366211545461965(+1) 
0.3624993110444317157003979(+1) 
0.6162058054822851183018884(+1) 
0.9891400587100292796094436(+1) 
0.1561759674811040987663091 (+2) 

11 0.4482320342657574276708926(—4) 
0.5207909623162271066376672(—2) 
0.5345475360211059123738409(—1) 
0.2309906558108135166129671 (+0) 
0.6533678661614568117244062(+0) 
0.1447701829626337088896548(+1) 
0.2748104892732672333011124(+1) 
0.4705876379525167685358156(+1) 
0.7521799853246243117155245(+1) 
0.1153453533217644455532991(+2) 
0.1756233860215826325656963(+2) 

12 0.2049481473588502707387955(—4) 
0.3116434971088132607069943(—2) 
0.3567129378808611001039353(—1) 
0.1637038106438552242938300(+0) 
0.4810226336846232242372423(+0) 
0.1093749789758291512953292(+1) 
0.2113272551481096162007134(+1) 
0.3658647547020350998536742(+l) 
0.5870258102208375738939594(+1) 
0.8943499910675443587138034(+1) 
0.1321831883068720792095974(+2) 
0.1952704436176789215551253(+2) 
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Table A.27. Sidi’s Quadrature Rules. 

/*oo k 

The nodes Xk,i of Sidi’s formulas / w(x)f(x)dx ~ A/, vi / (x,), where 

Jo i=1 

w(x) = x a e~ x (Case 1), or w(x) = x a E p (x), p > 1 (Case 2), are given below. 
The weights A^,i for these two cases are given separately, but the nodes remain the 
same in both cases. 


k Nodes xk,i 


2 0.13529666851116368734312115 
0.16424811092361409043110506(+01) 

3 0.4505096041273612628731663(—01) 
0.6767167970341259016621497 
0.3075107242553137972050534(+01) 

4 0.1666747355483805876646528(—01) 
0.3180181842758116537606890 
0.1552471013121895871047765(+01) 
0.4666443329047454410425080(+01) 

5 0.6575286461353594336586520(—02) 
0.1606142317401454028672786 
0.8655532227468952548875133 
0.2654640475454163235703710(+01) 
0.6359556084008965145949766(+01) 

6 0.2707864701816735328121392(—02) 
0.8508305148428640858724367(—01) 
0.5092057433688204133906909 
0.1639972558714133179393992(+01) 
0.3915248557178793725173108(+01) 
0.8124282662294926782302315(+01) 

7 0.1149791448528518322907199(—02) 
0.4664783979294682653256681 (—01) 
0.3106265453447279364212658 
0.1058211225813305334731752(+01) 
0.2590541885281939341616039(+01) 
0.5292380339780669851059954(+01) 
0.9942541657663614613190516(+01) 


Weights Ak,i (Case 1) 


0.7580234232710699835513690 

0.2419765767289300164486310 

0.4554540735108335506704450 
0.4982740688105893984787207 
0.4627185767857705085083424(—01) 

0.2559124314488475647034520 
0.5540725756664822258223339 
0.1821354548398085887398495 
0.7879538044861620734364579(—02) 

0.1402073401311772741711620 
0.4891155383497700586633836 
0.3175517522863648430356046 
0.5187500819320468386324305(—01) 
0.1250361039483140266606736(—02) 

0.7590679384919516304074620(—01) 
0.3882569073353100374747409 
0.3910982789957450034559817 
0.1317949666122117178283279 
0.1275405893635085165625092(—01) 
0.1889942711872265439523386(—03) 

0.4081165699922444055525246(—01) 
0.2916484563421986709994837 
0.4031742897215124443059980 
0.2164039357580742197306810 
0.4509850270751601688195192(—01) 
0.2535608913318645418197694(—02) 
0.2754955815556210853516167(—04) 
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Table A.27. Sidi’s Quadrature Rules, Continued. 


k Nodes Xk,i 


Weights Ak,i (Case 1) 


8 0.4994312298446427845065726(—03) 
0.2624962191042572294099059(—01) 
0.1946430851588193647017747 
0.7030609671769538287123412 
0.1179188598644186365876674(+01) 
0.3678545091181902027940886(+01) 
0.6758890871288327828074605(+01) 
0.1180256029366207606252295(+02) 

9 0.2207521317724925858938488(—03) 
0.1507552393251116722526709(—01) 
0.1245393110961793261601531 
0.4773846078371063555094626 
0.1252523841360254225620565(+01) 
0.2642940899971808063081664(+01) 
0.4675885820583371555261397(+01) 
0.8296284357470376096847307(+01) 
0.1369620449461662071770829(+02) 

10 0.9892395934161595489626947(—04) 
0.8801264957863189992681821(—02) 
0.8103177761469819944716406(—01) 
0.3297575418975984320679508 
0.8980931136795896724077270 

0.1940497820366211633196074(+01) 
0.3624993110444317167348184(+01) 
0.6162058054822850870745952(+01) 
0.9891400587100193449508436(+01) 
0.1561759674811040950577130(+02) 


0.2183694095237601731347362(—01) 
0.2123436066706023280859898 
0.3759015998592184903536997 
0.2797841689691778014757056 
0.9604431756368414199484653(—01) 
0.1350041606147886266984887(—01) 
0.5850466653776554364622037(—03) 
0.3903258084702669973656278(—05) 

0.1163948148700660433391451 (-01) 
0.1517165526134532491022856 
0.3298341874710617676412120 
0.3135048910910120987495115 
0.1530007866011305814318330 
0.3653427788604604752980879(—01) 
0.3655427407496274166283388(—02) 
0.1138550570413118897646681(—03) 
0.5403857520651553866290788(—06) 

0.6183607395711354252866023(—02) 
0.1071091101886063889549707 
0.2784453407952368949679836 
0.3208016909050212375820361 
0.2033397579357152368218497 
0.7082269642288027252226315(—01) 
0.1236216945865997469233175(—01) 
0.9144211000825651826936216(—03) 
0.2113241163514073803417835(—04) 
0.7338645093400497129421534(—07) 
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Table A.27. Sidi’s Quadrature Rules, Continued. 


k Nodes 2 +* 


11 0.4482320342657574489567133(—04) 
0.5207909623162271469395125(—02) 
0.5345475360211059413823949(—01) 
0.2309906558108135273776385 
0.6533678661614567980364082 
0.1447701829626337013453597(+01) 
0.2748104892732672279111629(+01) 
0.4705876379525167924577051(+01) 
0.7521799853246242986333288(+01) 
0.1153453533217644513798817(+02) 
0.1756233860215826167109416(+02) 

12 0.2049481473588502838963231 (—04) 
0.3116434971088132598181122(—02) 
0.3567129378808611226048581 (—01) 
0.1637038106438552243872225 
0.4810226336846232187336123 
0.1093749789758291561354613(+01) 
0.2113272551481096111677349(+01) 
0.3658647547020350981572865(+01) 
0.5870258102208375884709533(+01) 
0.8943499910675444211687219(+01) 
0.1321831883068720803236893(+02) 
0.1952704436176789300899542(+02) 


Weights Ak,i (Case 1) 


0.3275384530104277670283281 (—02) 
0.7501957741413657025016744(—01) 
0.2291117291836910307454911 
0.3090943534216158917513319 
0.2398422278869326897396240 
0.1107670005330865349182265 
0.2886106586282509163584454(—01) 
0.3810438741749370467894437(—02) 
0.2144416921941403642591808(—03) 
0.3770931329409887434130059(—05) 
0.9804334992569433381436212(—08) 

0.1730217229647563323727468(—02) 
0.5225852598266425798596882(—01) 
0.1852238054344086666606745 
0.2857579736265443988113541 
0.2607043547367742704644881 
0.1497818572726624001050412 
0.5279170686778839885617192(—01) 
0.1061556042946016328951724(—01) 
0.1087699857196495210286065(—02) 
0.4764646687998658382098453(—04) 
0.6508045093724211033391325(—06) 
0.1291464026287846155793969(—08) 
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Table A.27. Sidi’s Quadrature Rules with Weights Ak,i (Case 2), Continued. 


k 

Weights Ak,i (Case 2) 

2 

0.7580234232710699835513690 

0.2419765767289300164486310 

3 

0.4554540735108335506704450 
0.4982740688105893984787207 
0.4627185767857705085083424(—01) 

4 

0.2559124314488475647034520 
0.5540725756664822258223339 
0.1821354548398085887398495 
0.7879538044861620734364579(—02) 

5 

0.1402073401311772741711620 

0.4891155383497700586633836 
0.3175517522863648430356046 
0.5187500819320468386324305(—01) 
0.1250361039483140266606738(—02) 

6 

0.7590679384919516304074620(—01) 
0.3882569073353100374747409 
0.3910982789957450034559817 
0.1317949666122117178283279 
0.1275405893635085165625092(—01) 

7 

0.4081165699922444055525246(—01) 

0.2916484563421986709994837 

0.4031742897215124443059980 

0.2164039357580742197306810 

0.4509850270751601688195192(—01) 

0.2835608913318645418197694(-02) 

0.2154955815556210843516167(—04) 

8 

0.2183694095237601731347362(—01) 
0.2123436066706023280859898 
0.3759015998592184903336997 
0.2797841689691778014757056 
0.9604431756368414199484653(—01) 
0.1350041606147886266984887(-01) 
0.5850466653776554364622037(—03) 
0.3903258084702669973656278(—05) 

9 

0.1163948148700660433391451 (—01) 
0.1517165526134532491022856 
0.3298341874710617676412120 
0.3135048910910120987495115 

0.153000786601130581Q318330 
0.3653427788604604752980879(—01) 
0.3655427407496274166283388(—02) 
0.1138550570413118897646681 (—03) 
0.5403857520651553866290788(—06) 
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Table A.27. Sidi’s Quadrature Rules with Weights Ak,i (Case 2), Continued. 


k Weights Ak,i (Case 2) 


10 0.6183607395711354532866023(—02) 

0.1071091101886063889549707 
0.2784453407952368949679836 
0.3208016909050212375820361 
0.2033397579357152368218497 
0.7082269642288027252226315(—01) 
0.1236216945865997469233175(—01) 
0.9144211000825651826936216(—03) 
0.2113241163514073803417835(—04) 
0.7338645093400497129421534(—07) 


11 0.3275384530104277670293281(—02) 

0.7501957741413657025016744(—01) 
0.2291117291836910307454911 
0.3090943534216158917513319 
0.2398422278869326897396240 
0.1107670005330865349182265 
0.2886106586082509163584454(—01) 
0.3810438741749370467894437(—02) 
0.2144416921941403642591808(—03) 
0.3770931329409887434130059(—05) 
0.9804334992569433381436212(—08) 


12 0.1730217229647563323727468(—02) 

0.5225852598266425798596882(—01) 
0.1852238054344086666606745 
0.2857579736265443988113541 
0.2607043547367742704644881 
0.1497818572726624001050412 
0.5279170686778839885617192(—01) 
0.1061556042946016328951724(—01) 
0.1087699857196495210286065(—02) 
0.4764646687998658382098453(—04) 
0.6508045093724211033391325(—05) 
0.1291464026287846155793969(—08) 
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Table A.28. Values of Bj defined in (7.2.5). 


Do 

D x 

d 2 

D 3 

d 4 

D 5 

B 0 1 

0 

0 

0 

0 

0 

B-i, -2.5 

2.5 

0 

0 

0 

0 

B 2 3.375 

-11.5 

7.875 

0 

0 

0 

Bo -4.0625 

28.4375 

-51.1875 

26.8125 

0 

0 

B 4 4.6484375 

-55.78125 

184.078125 

-227.90625 

94.960903 

0 

B h -5.1679688 

99.746094 

-164.22656 

1055.7422 - 

-997.08984 344.44922 


Table A.29. Values of C n , n = 0(1)10, defined by (7.2.17). 

n 

Co 

Cx 

C 2 

C 3 

C 4 

C 5 

C 6 

C 7 

C 8 

Cg Cio 

0 

1 










1 

1 

1 









2 

2 

3 

1 








3 

5 

9 

5 

1 







4 

14 

28 

20 

7 

1 






5 

42 

90 

75 

35 

9 

1 





6 

132 

297 

275 

154 

54 

11 

1 




7 

429 

1001 

1001 

637 

273 

77 

13 

1 



8 

1430 

3432 

3640 

2548 

1260 

440 

104 

15 

1 


9 

4862 

11934 

13260 

9996 

5508 

2244 

663 

135 

17 

1 

10 

16796 

41990 

48450 

38760 

23256 

10659 

3705 

950 

170 

19 1 
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Table A.30. Coefficients of <f>^\x). 


N 

k 

1 

X 

X 2 

X 3 

X 4 

X 5 

X 6 

3 

1 

9 

-36 

30 






2 

-36 

192 

-180 






3 

30 

-180 

180 





4 

1 

16 

-120 

240 

-140 





2 

-120 

1200 

-2700 

1680 





3 

240 

-2700 

6480 

-4200 





4 

-140 

1680 

-4200 

2800 




5 

1 

25 

-300 

1050 

-1400 

630 




2 

-300 

4800 

-18900 

26880 

-12600 




3 

1050 

-18900 

79380 

-117600 

56700 




4 

-1400 

26880 

-117600 

179200 

-88200 




5 

630 

-12600 

56700 

-88200 

44100 



6 

1 

36 

-630 

3360 

-7560 

7560 

-2772 



2 

-630 

14700 

-88200 

211680 

-220500 

83160 



3 

3360 

-88200 

564480 

-1411200 

1512000 

-582120 



4 

-7560 

211680 

-1411200 

3628800 

-3969000 

1552320 



5 

7560 

-220500 

1512000 

-3969000 

4410000 

-1746360 



6 

-2772 

83160 

-582120 

1552320 

-1746340 

698544 


7 

1 

49 

-1176 

8820 

-29400 

48510 

-38808 

12012 


2 

-1176 

37632 

-317520 

1128960 

-1940400 

1596672 

-504504 


3 

8820 

-317520 

2857680 

-10584000 

18711000 

-15717240 

5045040 


4 

-29400 

1128960 

-10584000 

40320000 

-72765000 

62092800 

-20180160 


5 

48510 

-1940400 

18711000 

-72765000 

133402500 

-115259760 

37837800 


6 

-38808 

1596672 

-15717240 

62092800 

-115259760 

100590336 

-33297264 


7 

12012 

-504504 

5045040 

-20180160 

37837800 

-33297264 

11099088 
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Table A.31. Nodes and Weights for the 6') V -Rule. 


For N = 2, the nodes are: 

0.1882987963117412(+1) + i 0.3244796910641054(+1) 
0.2000000000000000(+l) + i 0.1414213562373095(+l) 
0.3008217622152272(+1) + i 0 

and the corresponding weights are: 

-0.88899 04409 694117(+0) + i 0.4070616686 678985(+0) 
0.39225 87291528748(-l) + i 0.26865 36655 316489(+0) 
0.26995 29136108248(+1) +i0. 


Table A.32. Values of p :l . 


n, k 

3 

pj 

40, 40 

1 

462.1042859692760191(+19) 

40, 39 

2 

—1.3818144531579131(+21) 

40, 38 

3 

4.3564892136190142(+22) 

40, 19 

22 

—2.0943817887520176(+33) 

40, 18 

23 

2.5922682191202954(+33) 

40, 17 

24 

-2.8444833911749354(+33) 

40, 16 

25 

2.7628672917493189(+33) 

40, 15 

26 

—2.3699585982237493(+33) 

35, 4 

227 

—1.2593960730679819(+24) 

35, 3 

228 

1.4372550728020953(+23) 

35, 2 

229 

—1.1487452598211684(+22) 

2, 1 

857 

4.3726366344881985(—14) 

2, 0 

858 

—1.8030596495382691(—15) 

1, 1 

859 

5.4318417593283853(—16) 

1 , 0 

860 

—3.3531316106852708(—17) 

0 , 0 

861 

—4.6289996351134026(—19) 
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matter. 
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Fig. 8.3.1. Haar Family of Wavelets. 
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Fig. 8.4.2. Shannon Wavelet ^(t). 

W) 



Fig. 8.4.3. Another Form of Shannon Wavelet ipit). 
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Fig. 8.4.5. Quadratic Battle-Lemarie Wavelet ip(t) 
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. 53A.pdf 


Continued 


2005 by Chapman & Hall/CRC Press 


550 


C. CONTENTS OF THE CD-R 


T2.53B.pdf 

T2.54A.pdf 

T2.55A.pdf 

T2.56C.pdf 

T2.58A.pdf 

T2.60A.pdf 

T2.63B.pdf 

T2.64B.pdf 

T2.67A.pdf 

T2.69B.pdf 

T2.70A.pdf 

T2.72C.pdf 

T2.73B.pdf 

T2.76B.pdf 


T2.53C.pdf 

T2.54B.pdf 

T2.55B.pdf 

T2.56D.pdf 

T2.58B.pdf 

T2.61A.pdf 

T2.63C.pdf 

T2.64C.pdf 

T2.67B.pdf 

T2.69C.pdf 

T2.71A.pdf 

T2.72D.pdf 

T2.74A.pdf 

T2.77A.pdf 


T2.53D.pdf 

T2.54C.pdf 

T2.55C.pdf 

T2.56E.pdf 

T2.58C.pdf 

T2.62A.pdf 

T2.63D.pdf 

T2.65A.pdf 

T2.67C.pdf 

T2.69D.pdf 

T2.71B.pdf 

T2.72E.pdf 

T2.75A.pdf 

T2.78A.pdf 


T2.53E.pdf 

T2.54D.pdf 

T2.56A.pdf 

T2.57A.pdf 

T2.59A.pdf 

T2.62B.pdf 

T2.63E.pdf 

T2.65B.pdf 

T2.68A.pdf 

T2.69E.pdf 

T2.72A.pdf 

T2.72F.pdf 

T2.75B.pdf 

T2.78B.pdf 


T3.01D.pdf 

T3.03A.pdf 

T3.08A.pdf 

T3.12A.pdf 

T3.17A.pdf 

T3.20C.pdf 

T3.23B.pdf 

T3.25B.pdf 

T3.26D.pdf 

T3.28C.pdf 

T3.31A.pdf 

T3.33A.pdf 

T3.36A.pdf 

T3.38A.pdf 

T3.40C.pdf 

T3.43A.pdf 

T3.46A.pdf 

T3.50B.pdf 

T3.53A.pdf 

T3.55A.pdf 

T3.57B.pdf 

T3.61B.pdf 


T2.53F.pdf 

T2.54E.pdf 

T2.56B.pdf 

T2.57B.pdf 

T2.59B.pdf 

T2.63A.pdf 

T2.64A.pdf 

T2.66A.pdf 

T2.69A.pdf 

T2.69F.pdf 

T2.72B.pdf 

T2.73A.pdf 

T2.76A.pdf 

T2.79A.pdf 


T3.01E.pdf 

T3.04A.pdf 

T3.09A.pdf 

T3.13A.pdf 

T3.18A.pdf 

T3.21A.pdf 

T3.24A.pdf 

T3.25C.pdf 

T3.27A.pdf 

T3.29A.pdf 

T3.31B.pdf 

T3.34A.pdf 

T3.36B.pdf 

T3.38B.pdf 

T3.41A.pdf 

T3.43B.pdf 

T3.47A.pdf 

T3.51A.pdf 

T3.53B.pdf 

T3.55B.pdf 

T3.58A.pdf 

T3.62A.pdf 


8.b.3. Infinite Range Definite Integrals: 


T3.01A.pdf 

T3.02A.pdf 

T3.05A.pdf 

T3.10A.pdf 

T3.14A.pdf 

T3.19A.pdf 

T3.21B.pdf 

T3.24B.pdf 

T3.26A.pdf 

T3.27B.pdf 

T3.29B.pdf 

T3.31C.pdf 

T3.35A.pdf 

T3.36C.pdf 

T3.39A.pdf 

T3.41B.pdf 

T3.43C.pdf 

T3.48A.pdf 

T3.51B.pdf 

T3.54A.pdf 

T3.56A.pdf 

T3.59A.pdf 

T3.63A.pdf 


T3.01B.pdf 

T3.02B.pdf 

T3.06A.pdf 

T3.10B.pdf 

T3.15A.pdf 

T3.20A.pdf 

T3.22A.pdf 

T3.24C.pdf 

T3.26B.pdf 

T3.28A.pdf 

T3.30A.pdf 

T3.32A.pdf 

T3.35B.pdf 

T3.37A.pdf 

T3.40A.pdf 

T3.42A.pdf 

T3.44A.pdf 

T3.49A.pdf 

T3.52A.pdf 

T3.54B.pdf 

T3.56B.pdf 

T3.60A.pdf 

T3.64A.pdf 


T3.01C.pdf 

T3.02C.pdf 

T3.07A.pdf 

T3.11A.pdf 

T3.16A.pdf 

T3.20B.pdf 

T3.23A.pdf 

T3.25A.pdf 

T3.26C.pdf 

T3.28B.pdf 

T3.30B.pdf 

T3.32B.pdf 

T3.35C.pdf 

T3.37B.pdf 

T3.40B.pdf 

T3.42B.pdf 

T3.45A.pdf 

T3.50A.pdf 

T3.52B.pdf 

T3.54C.pdf 

T3.57A.pdf 

T3.61A.pdf 

T3.65A.pdf 


8.c. SpecialFunctions.pdf 
8.d. TablesBiblio.pdf 
8.e. TablesNotation.pdf 


9. NewLaplaceInverses.pdf 


10. Quadrature Tables: Table A.01,Table A.32 


2005 by Chapman & Hall/CRC Press 


£ H 


Bibliography 


A. Abbate, C. M. deCusatis and P. K. Das, Wavelets and Subbands, Birkhauser, Boston 
MA, 2002. 

J. Abdalkhani, A modified approach to the numerical solution of linear weakly singular 
Volterra integral equations of the second kind, J. Integral Eqns. Appls., 5 (1993), 149- 
166. 

Aboufadel and S. Schlicker, Discovering Wavelets, Wiley, New York, 1999. 
Abramowitz and I. A. Stegun (eds.), Handbook of Mathematical Functions with For¬ 
mulas, Graphs and Mathematical Tables, National Bureau of Standards, Appl. Math. 
Series 55, U.S. Govt. Printing Office, Washington, DC; reprinted by Dover, New York, 
1968. 

A. Alaylioglu, G. A. Evans and J. Hyslop, The evaluation of integrals with infinite 
limits, J. Comp. Phys., 13 (1973), 433-438. 

_G. A. Evans and J. Hyslop, The use of Chebyshev series for the evaluation of 

oscillatory integrals, Computer J., 19 (1976), 258-267. 

P. Albrecht and G. Honig, Numerische Inversion der Laplace Transformierten, Ange- 
wandte Informatik, 18 (1977), 336-345. 

T. Alfrey, Non-homogeneous stress in viscoelastic media, Quart. Appl. Math., 2 (1944), 
113-119. 

R. S. Anderssen, F. R. De Hogg and M. A. Lukas (eds.), The Application and Numerical 
Solution of Integral Equations, Sijhoff and Noordhoff International Publishers, The 
Netherlands, 1980. 

_and P. M. Prenter, A formal comparison of methods proposed for the numerical 

solution of first kind Fredholm equations, J. Aust. Math. Soc., B 22 (1981), 488-500. 

D. D. Ang, J. Lind, and F. Stenger, Complex variable and regularization methods of 
inversion of the Laplace transform, Math. Comp., 53 (1989), 589-608. 

P. M. Anselone, Nonlinear Integral Equations, University of Wisconsin Press, Madison, 
1964. 

_, Collectively Compact Operator Approximation Theory and Applications to Integral 

Equations, Prentice-Hall, Englewood Cliffs, NJ, 1971. 

_, Singularity subtraction in the numerical solution of integral equations, J. Aust. 

Math. Soc., B 22 (1981), 408-418. 

_and R. H. Moore, Approximate solutions of integral and operator equations, J. 

Math. Anal. Appls., 9 (1964), 268-277. 

H. Antes, Uber die vierdimensionale Romberg-Integration mit Schranken, Computing, 9 
(1972), 45-52. 


551 


2005 by Chapman & Hall/CRC Press 



552 


BIBLIOGRAPHY 


P. Appell, Sur une classe de polynome a deux variables et le calcul approche des integrales 
double , Ann. Fac. Sci., Univ. Toulouse, 4 (1890), H1-H20. 

H. Ashley and M. Landahl, Aerodynamics of Wings and Bodies , Dover, New York, 1985. 

S. A. Ashour, Numerical solution of integral equations with finite part integrals , Interna¬ 
tional J. Math, and Math. Scs., 22 (1999), 155. 

K. E. Atkinson, Extension of the Nystrom method for the numerical solution of linear 
integral equations of the second kind, Ph.D. Thesis , University of Wisconsin, 1966. 

_, The numerical solution of Fredholm integral equations of the second kind , SIAM 

J. Numer. Anal., 4 (1967), 337-348. 

_, The numerical solution of an Abel integral equation by a product trapezoidal 

method , Report, Computer Center, Australian National University, Canberra (1971). 

_, The numerical solution of Fredholm integral equations of the second kind with 

singular kernels , Numer. Math., 19 (1972), 248-259. 

_, Iterative variants of the Nystrom method for the numerical solution of integral 

equations , Numer. Math., 22 (1973), 17-31. 

_, A Survey of Numerical Methods for the Solution of Fredholm Integrals Equations 

of the Second Kind , SIAM, Philadelphia, 1976. 

_, The Numerical Treatment of Integral Equations , Clarendon Press, Oxford, second 

printing, 1978. 

_, Piecewise polynomial collocation for integral equations on surfaces in three dimen¬ 
sions, J. Integral Eqns., 9 ((suppl.) 1985), 24-48. 

_, On the discrete Galerkin method for Fredholm integral equations of the second 

kind , IMA J. Numer. Anal., 9 (1989), 385. 

_, A survey of numerical methods for solving nonlinear integral equations , J. Integral 

Eqns. Appls., 4 (1992), 15. 

_, Numerical integration of line integrals , SIAM J. Numer. Anal., 30 (1993), 882-888. 

_, The Numerical Solution of Integral Equations of the Second Kind , Cambridge 

Univ. Press, Cambridge, 1997. 

_and J. Flores, The discrete collocation method for nonlinear integral equations , 

IMA J. Numer. Anal., 13 (1993), 195. 

_and G. F. Miller (eds.), Treatment of Integral Equations by Numerical Methods , 

Academic Press, London, 1982. 

_and I. H. Sloan, The numerical solution of first-kind logarithmic-kernel integral 

equations on smooth open arcs , Math, of Comput., 56 (1992), 119. 

E. E. Aubanel and K. B. Oldham, Fourier smoothing without the fast Fourier transform , 

BYTE, (February 1985), 207-218. 

F. August, Uber eine Verallgemeinerung der Gauss’schen Methode der mechanischen 

Quad-ratur , Arch. f. Mathem. u. Phys., 67 (1881), 72-93. 

E. Babolian and L. M. Delves, An augmented Galerkin method for first kind Fredholm 
equations , J. Inst. Math. Appl., 24 (1979), 157-174. 

V. A. Bakalets and N. P. Gritsyuk, Two numerical methods for solving integral equa¬ 
tions with a weak singularity , J. Soviet Math., 58 (1992), 202. 

C. T. H. Baker, On the nature of certain quadrature formulas and their errors , J. Numer. 
Anal., 5 (1968), 783-804. 

_, The Numerical Treatment of Integral Equations , Clarendon Press, Oxford, second 

printing, 1978. 

_, An introduction to the numerical treatment of Volterra and Abel-type integral 

equations , in Topics in Numerical Analysis (P. R. Turner, ed.), Lecture Notes in Math¬ 
ematics #965, Springer-Verlag, Berlin, 1982, pp. 1-35. 

C. T. H. Baker and M. S. Derakshan, Fast generation of quadrature rules with some 
special properties , in Numerical Integration — Recent Developments, Software and Ap¬ 
plications (P. Keast and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 
1987, pp. 53-60. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


553 


_, L. Fox, D. F. Mayers and K. Wright, Numerical solution of Fredholm integral 

equations of first kind , Computer J., 7 (1964), 141-148. 

_and G. F. Miller (eds.), Treatment of Integral Equations by Numerical Methods , 

Academic Press, London, 1982. 

N. S. Bakhnalov and L. G. Vasileva, Evaluation of the integrals of oscillating functions 
by interpolation at nodes of Gaussian quadratures , Z. Vycisl. mat. i mat. fiz., 8 (1968), 
175-181. (Russian) 

G. Balbine and J. N. Franklin, The calculation of Fourier integrals , Math. Comp., 20 

(1960), 570-589. 

R. Balian, Un principe d’incertitude fort en theoroe du signal ou en mecanique quantique , 
C. R. Acad. Sci. Paris, 292, (Serie II, 1981), 1357-1361. 

N. S. Bakhvalov and L. G. Vasil’eva, Evaluation of the integrals of oscillating functions 
by interpolation at nodes of Gaussian quadratures , SSSR Comp. Math. Phys., 8 (1968), 
241-249. 

N. K. Basu, Error estimates for a Chebyshev quadrature method , Math. Comp., 24 (1970), 
863-867. 

H. Bateman, Two systems of polynomials for the solution of Laplace’s integral equation , 
Duke Math. J., 2 (1936), 569-577. 

F. L Bauer, H. Rutishauser and E. Stiefel, New aspects in numerical quadrature , Proc. 

Symposia in Appl. Math., Amer. Math. Soc., Providence (1963), 199-219. 

R. E. Beard, Some notes on approximate product integration , J. Inst. Actu., 73 (1947), 
356-416. 

J. A. Belward, The solution of an integral equation of the first kind on a finite interval , 
Quart. Appl. Math., 27 (1969), 313-321. 

_, Further studies of the application of constrained minimization methods to Fredholm 

integral equations of the first kind , IMA J. Numer. Anal., 5 (1985), 125-139. 

D. A. Bell, Approximations in Fourier transforms , Comput. J., 6 (1963-1964), 244-247. 

R. Bellman, H. Kagiwada and R. E. Kalaba, Identification of linear systems via numer¬ 

ical inversion of Laplace transforms , IEEE Trans. Automatic Control, AC-10 (1965), 
111-112. 

_, R. E. Kalaba and J. A. Lockett, Numerical Inversion of the Laplace Transform: 

Applications to Biology, Economics, Engineering and Fhysics , American Elsevier, New 
York, 1966. 

I. S. Berezin and N. P. Zhidkov, Computing Methods , vol. 1, Addison-Wesley, Reading, 

MA, and Pergamon Press, Oxford, UK, 1965. (Russian) 

B. S. Berger, Tables of Zeros and Weights for Gauss-Legendre quadrature to 23-24S for 
n = 100,150, 200(100)900, Dept, of Mech. Eng., Univ. of Maryland, College Park, MD, 
1969a. 

_, Tables of Zeros and Weights for Gauss-Hermite quadrature to 26-27S for n = 

200(200)1000, 2000, Dept, of Mech. Eng., Univ. of Maryland, College Park, MD, 1969b. 

J. Berntsen and T. O. Espelid, Error estimation in automatic quadrature routines , ACM 

Trans. Math. Software, 17 (1991a), 233-252. 

_, T. O. Espelid and T. Soerevik, On the subdivision strategy in adaptive quadra¬ 
ture algorithms , J. Comp. Appl. Math., 35 (1991b), 119-132. 

S. N. Bernstein, On quadrature formulas of Cotes and Tschebyscheff , Doklady Akad. 

Nauk SSSR, 14 (1937), 323-326. (Russian) 

B. Bertram, Numerical implementation of a Brakhage-like technique for weakly singular 
integral equations using product integration , Computers & Math, with Applications, 26 
(1993), 21. 

_and O. Ruehr, Froduct integration for finite-part singular integral equations: nu¬ 
merical asymptotics and convergence acceleration , J. Comput. Appl. Math., 41 (1992), 
163. 

W. H. Beyer, CRC Standard Mathematical Tables , CRC Press, Boca Raton, FL, 1986. 


2005 by Chapman & Hall/CRC Press 



554 


BIBLIOGRAPHY 


B. Bialecki, A modified sine quadrature rule for functions with poles near the arc of 
integration, BIT, 29 (1989), 464-476. 

_, A sinc-Hunter quadrature rule for Cauchy principal value integrals , Math. Comp., 

55 (1990), 665-681. 

_, A sine quadrature rule for Hadamard finite part integrals , Numer. Math., 75 

(1990), 263-269. 

_, Sine quadrature for Cauchy principal value integrals , in Numerical Integration — 

Recent Developments, Software and Applications (T. O. Espelid and A. Genz, eds.), 
Kluwer, Dordrecht, 1992, pp. 81-92. 

C. Blatter, Wavelets: A Primer , A. K. Peters, Natick MA, 1998. 

N. Bleistein and R. A. Handelsman, Asymptotic Expansions of Integrals, Holt, Rinehart 
and Winston, New York, 1975. 

J. L. Blue, Automatic numerical quadrature — DQUAD, Computer Sc. Tech. Rep. 25 
(1975), Bell Labs., Murray Hill, NJ. 

_, Automatic numerical quadrature, Bell System Tech. J., 56 (1977,), 1651-1678. 

W. B. Bickford, A First Course in the Finite Element Method, Irwin, Boston, MA, 1990. 

R. P. Boas, Jr. and D. V. Widder, An inversion formula for the Laplace integral, Duke 
Math. J., 6 (1940), 1-26. 

W. R. Boland, The convergence of product-type quadrature formulas, SIAM J. Numer. 
Anal., 9 (1972), 6-13. 

_, The numerical solution of Fredholm integral equations using product-type quadra¬ 
ture formulas, BIT, 12 (1972a), 5-16. 

_, Algorithm 436. Product type trapezoidal integration, Comm. ACM, 15 (1972b), 

1070. 

_, Algorithm 437. Product type Simpson’s integration, Comm. ACM, 15 (1972c), 

1071. 

_, Algorithm 438. Product type two-point Gauss-Legendre-Simp son’s integration, Comm. 

ACM, 15 (1972d), 1071. 

_, Algorithm 439. Product type three-point Gauss-Legendre-Simp son’s integration, 

Comm. ACM, 15 (1972e), 1072. 

_, Properties of product-type quadrature formulas, BIT, 13 (1973), 287-291. 

B. A. Boley and C. C. Chao, Some solutions of the Timoshenko beam equations, J. Appl. 
Mech., 22 (1955), 579-586. 

J. P. Boris and E. S. Oran, Numerical evaluation of oscillatory integrals such as the 
modified Bessel function K^(x), J. Comp. Phys., 17 (1975), 425-433. 

G. Boros and V. H. Moll, An integral with three parameters, SIAM Rev., 40 (1998), 
972-980. 

_and V. H. Moll, An integral hidden in Gradshteyn and Ryzhik, J. Comput. Appl. 

Math., 106 (1999), 361-368. 

_and V. H. Moll, A sequence of unimodal polynomials, J. Math. Anal. Appl., 237 

(1999), 272-287. 

_and V. H. Moll, The double square root, Jacobi polynomials and Ramanujan’s 

Master Theorem, J. Comput. Appl. Math., 130 (2001), 337-344. 

_and V. H. Moll, Landen transformations and the integration of rational functions, 

Math. Comput., 71 (238) (2002), 649-668. 

_, O. Espinosa and V. H. Moll, On some families of integrals solvable in terms 

of polygamma and negapolygamma functions, Integr. Transf. Spec., 14 (3) (2003), 
187-203. 

J.-P. Boujot and P. Maroni, Algorithme general de construction de tables de Gauss pour 
les problemes de quadratures, Publ. No. MMX/8.1.8/AI. Inst. Blaise Pascal, Paris, 
1968. 

R. N. Bracewell, The discrete Hartley transform, J. Optical Soc. of America, 73 (1983), 
1832. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


555 


_, The Hartley Transform, Oxford University Press, New York, 1986. 

H. Brakhage, Uber die numerische Behandlung von Integralgleichungen nach der Quad¬ 
rature Formelmethode, Numer. Math., 2 (1960), 183-196. 

M. Branders and R. Piessens, Algorithm 001: An extension of Clenshaw-Curtis quadra¬ 
ture , J. Comp. Appl. Math., 1 (1965), 55-65. 

_R. Piessens, Algorithm 1: An extension of Clenshaw-Curtis quadrature , J. Comp. 

Appl. Math., 1 (1975), 55-65. 

H. Brass (BraB), Quadraturverfahren , Vandenhoeck und Ruprecht, Gottingen, 1977. 

C. Brezinski, A subroutine for the general interpolation and extrapolation problems , ACM 

Trans. Math. Software, 8 (1982), 290-301. 

J. Bronstein, Integration of elementary functions, J. Symbol. Comput., 9 (1990), 117-173. 

_, Symbolic Integration I — Transcendental Functions, Springer-Verlag, Berlin, 1996, 

pp. 117-173. 

R. Broucke, Algorithm 446: Ten subroutines for the manipulation of Chebyshev series, 
Comm. ACM, 16 (1973), 254-256. 

T. A. Brown, Fourier’s integral, Proc. Edinburgh Math. Soc., 34 (1915-1916), 3-10. 

R. Bulirsch, Bemerkungen zur Romberg integration, Num. Math., 6 (1964), 1-13. 

_and J. Stoer, Numerical quadrature by extrapolation, Num. Math., 9 (1967), 271- 

278. 

O. Buneman, Conversion of FFT’s to fast Hartley transforms, SIAM J. Sci. Stat. Comput., 
7 (1986), 624-638. 

R. S. Burington (ed.), Handbook of Mathematical Tables and Formulas, McGraw-Hill, 
New York, 1962. 

J. S. Byrnes (ed.), Wavelets and Their Applications, Kluwer Academic Publisher, 1994. 

D. -W. Byun and S. Saitoh, A real inversion formula for the Laplace transform, Zeitschrift 

fiir Analysis und ihre Anwendungen, 12 (1993), 597-603. 

A. P. Calderon, An atomic decomposition of distributions in parabolic H p spaces, Ad¬ 
vances in Math., 25 (1978), 85-96. 

J. Caldwell, Numerical study of Fredholm integral equations, Inti. J. Math. Educ., 25 
(1994), 831-836. 

F. Calio and E. Marchetti, Derivation and implementation of an algorithm for singular 

integrands, Computing, 38 (1987), 235-245. 

_and E. Marchetti, Complex Gauss-Kronrod integration rules for certain Cauchy 

principal value integrals, Computing, 50 (1993), 165-173. 

T. Cao, Hierarchical basis methods for hypersingular integral equations, IMA J. Numer. 
Anal., 17 (1997), 603. 

O. Carino, I. Robinson and E. deDoncker, An algebraic study of the Levin transform in 
numerical integration, in Numerical Integration — Recent Developments, Software and 
Applications (T. O. Espelid and A. Genz, eds.), Kluwer, Dordrecht, 1992, pp. 175-186. 

G. F. Carrier, M. Krook and C. E. Pearson, Functions of a Complex Variable, McGraw- 

Hill, New York, 1966. 

C. Carstensen and E. P. Stephan, Adaptive boundary element methods for some first 
kind integral equations, SIAM J. Numer. Anal., 33 (1996), 2166. 

J. Cassaletto, M. Picket and J. R. Rice, A comparison of some integration programs, 
SIGNUM Newsletter, 4 (1969), 30-40. 

J. L. Casti, A family of Fredholm integral equations, Problem 72-2, SIAM Rev. , 15 (1973), 
220 - 221 . 

_, R. Kalaba and S. Ueno, Cauchy systems for Fredholm integral equations with 

parameter imbedding, Appl. Math. Comput., 108 (2000), 47. 

Ll. G. Chambers, Integral Equations. A Short Course, International Textbook Co. Ltd., 
London, 1976. 

S. M. Chase and L. D. Fosdick, An algorithm for Filon quadrature, Comm. ACM, 12 

(1969), 453-457. 


2005 by Chapman & Hall/CRC Press 




556 


BIBLIOGRAPHY 


M. M. Chawla, On the Chebyshev polynomials of the second kind, SIAM Rev., 9 (1967), 
729-733. 

_, Convergence of Newton-Cotes quadratures for analytic functions, BIT, 11 (1971), 

159-167. 

_ and S. Kumar, Convergence of quadratures for Cauchy principal value integrals, 

Computing, 23 (1979), 67-72. 

P. L. Chebychev, On quadratures , J. Math. Pures Appl., (2), 19 (1874), 19-34. 

T. H. C. Chen, Asymptotic error estimates for Gaussian quadrature formulas , Math. 
Comp., 38 (1982), 143-152. 

E. W. Cheney, Introduction to Approximation Theory , McGraw-Hill, New York, 1966. 

G. W. Cherry, Integration infinite terms with special functions: The logarithmic integral, 
SIAM J. Comput., 15 (1986), 1-21. 

C. Chiarella and A. Reichel, On the evaluation of integrals related to the error function, 
Math. Comp., 22 (1968), 137-143. 

C. Chiodo and G. Criscuolo, On the convergence of a rule by Monegato for the numerical 
evaluation of Cauchy principal value integrals, Computing, 40 (1988), 67-74. 

J. S. R. Chisholm, A. Genz and G. E. Rowlands, Accelerated convergence of sequences, 
J. Comp. Phys., 10 (1972), 284-307. 

E. B. Christoffel, Uber die Gaussische Quadratur und eine Verallgemeinerungderselben, 
J. Reine Angew. Math., 55 (1858), 61-82. 

A. C. Chrysakis and G. Tsamasphyros, Numerical solution of Cauchy type singular inte¬ 
gral equations with logarithmic weight, based on arbitrary collocation points, Comput. 
Mech., 7 (1990), 21. 

_and G. Tsamasphyros, Numerical solution of integral equations with a logarith¬ 
mic kernel by the method of arbitrary collocation points, Inti. J. Numer. Methods in 
Elasticity, 33 (1992), 143. 

C. K. Chui, An Introduction to Wavelets, Academic Press, 1992. 

_, Wavelets: A Mathematical Tool for Signal Analysis, SIAM, Philadelphia, 1997. 

W. W. Clendenin, A method for numerical calculation of Fourier integrals, Numer. Math., 
8 (1966), 422-436. 

C. W. Clenshaw, The numerical solution of linear differential equations in Chebyshev 
series, Proc. Camb. Phil. Soc., 53 (1957), 134-149. 

_, Chebyshev series for mathematical functions, Math. Tables, 5 (1962), National 

Physical Laboratory, London: H.M.S.O.. 

_and A. R. Curtis, A method for numerical integration on an automatic computer, 

Numer. Math., 12 (1960), 197-205. 

J. A. Cochran, An Analysis of Linear Integral Equations, McGraw-Hill, New York, 1972. 

A. M. Cohen, Cautious Romberg extrapolation, Int. J. Comp. Math., 8 (1980), 137-147. 

R. Coifman, A real variable characterization of H p , Studia Mat., 51 (1974). 

_and Y. Meyer, Remarques sur Tanalyse de Fourier a fenetre, C. R. Acad. Sci. Paris 

Ser. I (1991a), 259-261. 

_and Y. Meyer, Ondelettes et Operateurs III: Operateurs Multilineaires, Hermann, 

Paris, 1991b. 

_Y. Meyer and V. Wickerhauser, Size properties of wavelet packets, in Wavelets 

and Their Applications (M. B. Ruskai, G. Beylkin, R. Coifman, I. Daubechies, S. 
Mallat, Y. Meyer, L. Raphael, eds.), Jones & Bartlett, Boston, MA, 1992, pp. 453-470. 

_and G. Weiss, Review of Littlewood-Paley and multiplier theory, Bull. Amer. Math. 

Soc., 84 (1977a), 242-250. 

T. F. Coleman and C. VanLoan, Handbook for Matrix Computations, SIAM, Philadel¬ 
phia, PA, 1988. 

S. D. Conte and C. de Boor, Elementary Numerical Analysis, 2nd ed., McGraw-Hill, 

New York, 1972. 

J. W. Cooley and J. W. Tukey, An algorithm for the machine calculation of complex 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


557 


Fourier series, Math. Comput., 19 (1965), 297-301. 

_, P. A. W. Lewis and P. D. Welch, The fast Fourier transform and its applications, 

IEEE Trans. Educ. E-12, 1 (1969), 27-34. 

_, P. A. W. Lewis and P. D. Welch, The fast Fourier transform algorithm: Pro¬ 
gramming considerations in the calculation of sine, cosine and Laplace transforms , J. 
Sound Vib., 12 (1970), 315-337. 

D. K. Cope, Convergence of Piessens’ method for numerical inversion of the Laplace 
transform on the real line , SIAM J. Numer. Anal., 27 (1990), 1345-1354. 

G. F. Corliss, Performance of self-validating adaptive quadrature , in Numerical Integra¬ 
tion — Recent Developments, Software and Applications (P. Keast and G. Fairweather, 
eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 239-259. 

_and G. Krenz, Indefinite integration with validation , ACM Trans. Math. Software, 

15 (1989), 375-393. 

T. L. Cost, Approximate Laplace transform inversions in viscoelastic stress analysis , AIAA 
Journal, 2 (1964), 2157-2166. 

R. Cranley and T. N. L. Patterson, On the automatic numerical evaluation of definite 
integrals , Math. Comput., 14 (1971), 189-198. 

G. Criscuolo and G. Mastroianni, On the convergence of an interpolatory product rule 
for evaluating Cauchy principal value integrals , Math. Comp., 48 (1987), 725-735. 

_and G. Mastroianni, On the convergence of an interpolatory product rule for the 

evaluation of derivatives of Cauchy principal value integrals , SIAM J. Numer. Anal., 
25 (1988), 713-727. 

_and G. Mastroianni, On the uniform convergence of Gaussian quadrature rules 

for Cauchy principal value integrals , Numer. Math., 54 (1989), 445-461. 

K. S. Crump, Numerical inversion of Laplace transforms using a Fourier series approxi¬ 
mation , J. Assoc. Comp. Mach., 23 (1976), 89-96. 

A. D’Alessio, L. A. Amore and G. Laccetti, An effective discretization error estimate of 
Fourier series methods for the numerical inversion of the Laplace transform , Richerche 
di Matem., 43 (1994), 293-307. 

L. D’Amore, G. Laccetti and A. Murli, An implementation of a Fourier series method 

for the numerical inversion of the Laplace transform , ACM Trans. Math. Software, 25 
(1999a), 279-305. 

_,G. Laccetti and A. Murli, Algorithm 796: A Fortran Software Package for 

the Numerical Inversion of the Laplace Transform , ACM Trans. Math. Software, 25 
(1999b), 306-315. 

C. Dagnino, Extended product integration rules , BIT, 15 (1983), 488-499. 

_and C. Fiorentino, Computation of nodes and weights of extended Gaussian rules, 

Computing, 32 (1984), 271-278. 

_and A. Palamara-Orsi, Product integration of piecewise continuous integrands 

based on cubic spline interpolation at equally spaced nodes , Numer. Math., 52 (1988), 
459-466. 

_, Extensions of some results for interpolatory product integration rules to rules not 

necessarily of interpolatory type, SIAM J. Numer. Anal., 23 (1986), 1284-1289. 

_, Product integration of singular integrands based on cubic spline interpolation at 

equally spaced nodes, Numer. Math., 57 (1990), 97-104. 

_and E. Santi, On the evaluation of one-dimensional Cauchy principal value inte¬ 
grals by rules based on cubic spline nodes, Computing, 43 (1990), 267-276. 

_and E. Santi, On the convergence of spline product quadratures for Cauchy prin¬ 
cipal value integrals, J. Comput. Appl. Math., 36 (1991), 181-187. 

_, V. Demichelis and E. Santi, An algorithm for numerical integration based on 

quasi-interpolating splines, Numer. Algorithms, 5 (1993), 443-452. 

_, V. Demichelis and E. Santi, Numerical integration based on quasi-interpolating 

splines, Computing, 50 (1993), 149-163. 


2005 by Chapman & Hall/CRC Press 





558 


BIBLIOGRAPHY 


I. Daubechies, Orthonormal basis of compactly supported wavelets, Comm. Pure Appl. 

Math., 41 (1988), 996. 

_, The wavelet transform, time-frequency localization and signal analysis , IEEE 

Trans. Inform. Theory, 36 (1990), 961-1005. 

_, Ten Lectures on Wavelets , CBS-NSF Regional Conf. in Appl. Math., 61, SIAM, 

1992. 

_, A. Grossman and Y. Meyer, Painless nonorthogonal expansions , J. Math. Phys., 

27 (1986), 1271-1283. 

_, S. Jaffard and J. L. Journe, A simple Wilson orthonormal basis with exponential 

decay , SIAM J. Math. Anal., 22 (1991), 554-572. 

_, S. Mallat and A. S. Willsky (eds.), Special issue on wavelet transforms and 

multiresolution signal analysis , IEEE Trans. Inform. Theory, 38 (1992). 

_and J. Lagarias, Two scale-difference equations, I, Existence and global regularity 

of solution, SIAM J. Math. Anal., 22 (1991), 1388-1410. 

_and J. Lagarias, Two scale-difference equations, II, Local regularity, infinite prod¬ 
ucts of matrices and fractals, SIAM J. Math. Anal., 23 (1992), 1031-1079. 

J. H. Davenport, On the Integration of Algebraic Functions, Lecture Notes in Computer 

Science, #102, Springer-Verlag, Berlin, 1981. 

B. Davies, Integral Transforms and Their Applications, Springer-Verlag, New York, 1978. 
_ and B. Martin, Numerical inversion of the Laplace transform: A survey and com¬ 
parison of methods, J. Comput. Phys., 33 (1979), 1-32. 

P. J. Davis, On the numerical integration of periodic analytic functions, in On Numerical 
Approximation (R. Langer, eds.), Univ. of Wisconsin Press, Madison, MI, 1959, pp. 45- 
59. 

_, Error of numerical approximation for analytic functions, in Survey of Numerical 

Analysis (R. E. Langer, ed.), The University of Wisconsin press, Madison, WI, 1962, 
pp. 45-60. 

_, A construction of nonnegative approximate quadratures, Math. Comp., 21 (1967), 

578-582. 

_, Interpolation and Approximation, Blaisdell, New York, 1963; Dover, New York, 

1976. 

_, A construction of nonnegative approximate quadratures, Math. Comput., 21 (1967), 

578-582. 

_and P. Rabinowitz, Numerical Integration, Ginn (Blaidell), Boston, MA, 1967. 

_and P. Rabinowitz, Methods of Numerical Integration, 2nd ed., Academic Press, 

New York, 1984. 

C. de Boor, On writing an automatic integration algorithm, in Mathematical Software (J. 

R. Rice, ed.), Academic Press, New York, 1971a. 

_, Cadre: An algorithm for numerical quadrature, in Mathematical Software (J. R. 

Rice, eds.), Academic Press, New York, 1971b, pp. 417-449. 

_, A Practical Guide to Splines, Appl. Math. Scs., Vol. 27, Springer-Verlag, New 

York, 1978. 

_, Good approximation by spline with variable knots, in Spline Functions and Ap¬ 
proximation Theory, Birkhauser, Basel, 1973. 

_and A. Ron, On multivariate polynomial interpolation, Constryct. Approx., 6 (1990), 

287-302. 

_and A. Ron, The least solution for the polynomial interpolation problem, Math. Z., 

210 (1992), 347-378. 

E. de Doncker, Asymptotic expansions and their application in numerical integration, in 
Numerical Integration — Recent Developments, Software and Applications (P. Keast 
and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 141-151. 

_and R. Piessens, A bibliography on automatic integration, J. Comput. App. Math., 

2 (1976a), 273-280. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


559 


_and R. Piessens, Algorithm 32. Automatic computation of integrals with singular 

integrand, over a finite or infinite range, Computing, 17 (1976b), 265-279. 

_and I. Robinson, An algorithm for automatic integration over a triangle using 

non-linear extrapolation , ACM Trans. Math. Software, 10 (1984), 1-16. 

F. R. de Hoog and R. Weiss, On the solution of Volterra integral equations of the first 
kind , Numer. Math., 21 (1973a), 22-32. 

_, Asymptotic expansions for product integration , Math. Comput. , 27 (1973b), 295- 

306. 

_, J. H. Knight and A. N. Stokes, An improved method for numerical inversion of 

Laplace transforms, SIAM J. Sci. Comput., 3 (1982), 357-366. 

J. H. De Klerk, Solution of integral equations via L\-approximations, Inti. J. Control, 48 

(1988), 2121-2128. 

_, The sensitivity of a computational L\-approximation technique in integral equa¬ 
tions, Appl. Math. Comput., 62 (1994), 171-182. 

_, D. Eyre and L. M. Verner, L v -Approximation method for the numerical solution 

of singular integral equations, Appl. Math. Comput., 72 (1995), 285-300. 

D. Delbourgo and D. Elliott, On the approximate evaluation of Hadamard finite-part 
integrals, IMA J. Numer. Anal., 14 (1994), 485-500. 

L. M. Delves, A fast method for the solution of integral equations, J. Inst. Math. Appl., 

20 (1977), 173-182. 

_and L. P. Abd-Elal, Algorithm 97. The fast Galerkin algorithm for the solution 

of linear Fredholm equations, Comput. J., 20 (1977), 374-376. 

_and J. Walsh (Eds.), Numerical Solution of Inteqral Equations, Clarendon Press, 

Oxford, 1974. 

_and J. L. Mohamed, Computational Methods for Integral Equations, Cambridge 

University Press, Cambridge, 1985. 

_and L. F. Abd-Elal, Algorithm 97. The fast Galerkin algorithm for the solution 

of linear Fredholm equations, Comput. J., 20 (1977), 374-376. 

_, L. F. Abd-Elal and J. A. Hendry, A fast Galerkin algorithm for singular integral 

equations, J. Inst. Math. Appl., 23 (1979), 139-166. 

_, L. F. Abd-Elal and J. A. Hendry, A set of modules for the solution of integral 

equations, Comput. J., 24 (1981), 184-190. 

A. M. Denisov and A. S. Krylov, Numerical solution of integral equations of the first 
kind, Comput. Math, and Modeling, 1 (1990), 137. 

P. Dierck and R. Piessens, Calculation of Fourier coefficients of discrete functions using 
cubic splines, J. Comput. Appl. Math., 3 (1977), 207-209. 

K. Diethelm, Modified compound quadrature rules for strongly singular integrals, Com¬ 
puting, 52 (1994), 337-354. 

B. Dietmar and P. Junghanns, New error bounds for the quadrature method for the 
solution of Cauchy singular integral equations, SIAM J. Numer. Anal., 30 (1993), 
1351. 

V. Dixon, Bibliography, in Software for Numerical Mathematics (D. J. Evans, ed.), Aca¬ 
demic Press, New York, 1974, pp. 105-137. 

M. L. Dow and D. Elliott, The numerical solution of singular integral equations over 
[-1,1], SIAM J. Numer. Anal., 16 (1979). 

H. Dubner and J. Abate, Numerical inversion of Laplace transforms by relating them to 
the finite Fourier cosine transform, J. Assoc. Comp. Mach., 15 (1968), 115-123. 

D. G. Duffy, On the numerical inversion of Laplace transforms: A survey of three new 
methods on characteristic problems from applications, ACM Trans. Math. Software, 19 
(1993), 333-359. 

F. Durbin, Numerical inversion of Laplace transforms: An efficient improvement to Dub¬ 
ner and Abaters method, The Computer J., 17 (1974), 371-376. 

C. S. Duris, A simplex sufficiency condition for quadrature formulas, Math. Comp., 20 


2005 by Chapman & Hall/CRC Press 



560 


BIBLIOGRAPHY 


(1966), 68-78. 

_, Optimal quadrature formulas using generalized inverses. Pt. I. General theory and 

minimum variance formulas, Math. Comp., 25 (1971), 495-504. 

_, The ( q,r) copy of product-type Newton-Cotes quadrature formulas, Math. Rep. 

(1974), Drexel University, Philadelphia. 

P. P. B. Eggermont and Ch. Lubich, Fast numerical solution of singular integral equa¬ 
tions, J. Integral Eqns. Appls., 6 (1994), 335. 

U. T. Ehrenmark, A three-point formula for numerical quadrature of oscillatory integrals 
with variable frequency, J. Comput. Appl. Math., 21 (1988), 87-99. 

B. Einarsson, Algorithm 418. Calculation of Fourier integrals, Comm. ACM, 15 (1972), 
47-48. 

S. E. El-gendi, Chebyshev solution of differential, integral and integro-differential equa¬ 
tions, Comput. J., 12 (1969), 282-287. 

D. Elliott, A Chebyshev series method for the numerical solution of Fredholm integral 
equations, Comput. J. 6 (1963), 102-111. 

_, Truncation errors in two Chebyshev series approximations, Math. Comp., 19 

(1965), 234-248. 

_, A Chebyshev series method for the numerical solution of Fredholm integral equa¬ 
tions, Comput. J., 6 (1963), 102-111. 

_and W. G. Warne, An algorithm for the numerical solution of linear integral equa¬ 
tions, ICC Bull. (Inti. Comput. Cent.), 6 (1967), 207-224. 

_and D. F. Paget, On the convergence of a quadrature rule for evaluating certain 

Cauchy principal value integrals, Numer. Math., 23 (1975), 311-319. 

_and D. F. Paget, On the convergence of a quadrature rule for evaluating certain 

Cauchy principal value integrals — An addendum, Numer. Math., 25 (1976), 287-289. 

_ and D. F. Paget, Product-integration rules and their convergence, BIT, 16 (1976), 

32-40. 

_ and D. F. Paget, Convergence of product integration rules, BIT, 18 (1978), 137-141. 

_and D. F. Paget, Gauss type quadrature rules for Cauchy principal value integrals, 

Math. Comp., 33 (1979), 301-309. 

_and D. F. Paget, Gauss type quadrature rules for Cauchy principal value integrals, 

Math. Comp., 33 (1979), 301-309. 

_, The convergence of product integration rules, BIT, 18 (1978), 137-141. 

_, An asymptotic analysis of two algorithms for certain Hadamard finite-part inte¬ 
grals, IMA J. Numer. Anal., 13 (1993), 445-462. 

H. Engels, Eine Zusammenstellung von Arbeiten uber numerische Quadratur und Kubatur, 
Report, Jiil-Bibl., 16 (1972), Nuclear Res. Centre, Jiilich. 

_, Numerical Quadrature and Cubature, Academic Press, London, 1980. 

A. Erdelyi, Inversion formulae for the Laplace transformation, Phil. Mag., 34 (1943a), 
533-537. 

_, Note on an inversion formula for the Laplace transformation, J. London Math. 

Soc., 18 (1943b), 72-77. 

_(ed.), Tables of Laplace transforms. Bateman Manuscripts Project, Vol. I, McGraw- 

Hill, New York, 1954. 

_, Asymptotic representations of Fourier integrals and the method of stationary 

phase, J. SIAM, 3 (1955), 17-27. 

_, An integral equation involving Legendre’s polynomial., Amer. Math. Monthly, 70 

(1963), 651-652. 

_, An integral equation involving Legendre functions, J. Soc. Industr. Appl. Math., 

12 (1964), 15-30. 

_, Some integral equations involving finite parts of divergent integrals, Glasgow Math. 

J., 8 (1967), 50-54. 

_, W. Magnus, F. Oberhettinger, and F. G. Tricomi, Higher Transcendental 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


561 


Functions, Vol. II, McGraw-Hill, New York, 1953. 

F. Erdogan and G. D. Gupta, On the numerical solution of singular integral equations, 

Quart. Appl. Math., 30 (1972), 525. 

_, G. D. Gupta and T. S. Cook, Numerical solution of singular integral equations, 

in Methods of Analysis and Solution of Crack Problems (G. C. Sih, ed.), Mechanics of 
Fracture, Vol. 1, Noordhoff, Leyden, 1973, pp. 368-425. 

W. Essah, L. M. Delves, and J. Belward, A cross validation Galerkin algorithm for 
first kind integral equations, Preprint (1986), Dept, of Statistics and Computational 
Mathematics, University of Liverpool. 

_and L. M. Delves, The numerical solution of first kind integral equations, J. Corn- 

put. Appl. Math., 27 (1989), 363-387. 

T. O. Espelid, On the construction of good symmetric integration rules, SIAM J. Numer. 
Anal., 24 (1987), 855-881. 

_and T. Soerevik, A discussion of a new error estimate for adaptive quadrature, 

BIT, 29 (1989), 283-294. 

T. O. Espelid, Dqaint: An algorithm for adaptive quadrature (of a vector function) over 
a collection of finite intervals, in Numerical Integration — Recent Developments, Soft¬ 
ware and Applications (T. O. Espelid and A. Genz, eds.), Kluwer, Dordrecht, 1992, 
pp. 341-342. 

_and A. Genz (eds.), Numerical Integration — Recent Developments, Software and 

Applications, Kluwer, Dordrecht, 1992. 

_, On integrating vertex singularities using extrapolation, BIT, 34 (1994), 62-79. 

_and K. J. Overholt, Dqainf: An algorithm for automatic integration of infinite 

oscillating tails, Numer. Algorithms, 8 (1994), 83-101. 

W. Essah, L. M. Delves, and J. Belward, A cross validation Galerkin algorithm for 
first kind integral equations, Preprint (1986), Dept, of Statistics and Computational 
Mathematics, University of Liverpool. 

_and L. M. Delves, The numerical solution of first kind integral equations, J. Corn- 

put. Appl. Math., 27 (1989), 363-387. 

G. A. Evans, Integrating oscillatory integrands of a non-trigonometric type over a finite 
range, Int. J. Comp. Math., 42 (1992), 213-221. 

_, Practical Numerical Integration, Wiley, Chichester, UK, 1993. 

_, Two robust methods for irregular oscillatory integrals over a finite range, Appl. 

Numer. Math., 14 (1994), 383-395. 

G. A. Evans, R. C. Forbes, and J. Hyslop, Polynomial transformations for singular 
integrals, Inti. J. Computer Math., 14 (1983), 157-170. 

_J. Hyslop and A. P. G. Morgan, An extrapolation procedure for the evaluation of 

singular integrals, Int. J. Comp. Math., 12 (1983), 251-265. 

G. Fairweather, Algorithm 351. Modified Romberg quadrature, Comm. ACM, 12 (1969), 
324-325. 

P. Favati, G. Lotti and F. Romani, Local error estimates in quadrature, BIT, 31 (1991a), 
102 - 111 . 

_, G. Lotti and F. Romani, Algorithm 691: Improving QUADPACK automatic 

integration routines, ACM Trans. Math. Software, 17 (1991b), 218-232. 

L. Fejer, Mechanische Quadraturen mit positiven Cotes’schen Zahlen, Math. Z., 37 (1933), 
287-310. 

W. J. Felts, Numerical inversion of the Laplace transform, IEEE Trans. Automatic Con¬ 
trol, AC-14 (1969), 297-299. 

_and G. E. Cook, Numerical inversion of the Laplace transform, IEEE Trans. Au¬ 
tomatic Control, AC-14 (1969), 297-299. 

W. E. Ferguson, Jr., A simple derivation of Glassman’s general N fast Fourier transform, 
Comput. Math. Appl., 8 (1982)), 401-411. 

S. E. Ferrando, L. A. Kolasa and N. Kovacevic, Algorithm 821: A flexible implemen- 


2005 by Chapman & Hall/CRC Press 



562 


BIBLIOGRAPHY 


tation of matching pursuit for Gabor functions on the interval, ACM Trans. Math. 
Software, 28 (2002), 337-353. 

S. Filippi, Angenaherte Tschebyscheff-Approximation einer Stammfunktion — cine Modi- 
fikation des Verfahrens von Clenshaw und Curtis, Numer. Math., 6 (1964/29), 320-328. 

L. N. G. Filon, On a quadrature formula for trigonometric integrals, Proc. Royal Soc. 
Edinburgh, 49 (1928/29), 38-47. 

L. Flatto and S. Haber, A quadrature formula of degree three, J. Approx. Theory, 9 
(1971), 44-52. 

A. Fletcher, J. C. P. Miller, L. Rosenhead and L. J. Comrie, An Index of Mathe¬ 
matical Tables, 2nd. ed., Addison-Wesley, Reading, MA, 1962. 

E. A. Flinn, A modification of Filon’s method for numerical integration, J. ACM, 7 (1960), 
181-184. 

W. F. Ford and A. Sidi, An algorithm for a generalization of the Richardson extrapolation 
process, SIAM J. Numer. Anal., 24 (1987), 1212-1232. 

K. -J. Forster, On quadrature formulae near Gaussian quadrature, in Numerical Integra¬ 

tion — Recent Developments, Software and Applications (T. O. Espelid and A. Genz, 
eds.), Kluwer, Dordrecht, 1992, pp. 45-54. 

E. Foufoula-Georgion and P. Kumar (eds.), Wavelets in Geophysics, Wavelet Analysis 
and Its Applications, Vol. 4, Academic Press, San Diego, 1994. 

L. Fox and I. B. Parker, Chebyshev Polynomials in Numerical Analysis, Oxford Univ. 

Press, Oxford, 1957. 

P. Franklin, A set of continuous orthogonal functions, Math. Ann., 100 (1928), 522-529. 

W. Fraser and M. W. Wilson, Remarks on the Clenshaw-Curtis quadrature scheme, 
SIAM Rev., 8 (1966), 322-327. 

G. Freud, Orthognale Polynome, Birkhauser Verlag, Basel, 1969. 

D. Gabor, Theory of communications, J. IEEE, 93 (1946), 429-457. 

B. S. Garbow, J. M. Boyle, J. J. Dongarra and C. B. Moler, Matrix Pigensystem 
Routines — PISPAGK Guide Pxtension, Lecture Notes in Computer Science #51, 
Springer-Verlag, Berlin, 1977. 

_, G. Giunta, J. N. Lyness and A. Murli, Software for an implementation of 

Weeks’ method for the numerical inversion of the Laplace transform problem, ACM 
Trans. Math. Software, 14 (1988a), 163-170. 

_,G. Giunta, J. N. Lyness and A. Murli, Algorithm 662, A Fortran software pack¬ 
age for the numerical inversion of the Laplace transform based on Weeks’ method, 
ACM Trans. Math. Software, 14 (1988b), 171-176. 

_and J. N. Lyness, Remark on “Algorithm 662: A Fortran software package for the 

numerical inversion of the Laplace transform based on Weeks’ method”, ACM Trans. 
Math. Software, 16 (1990), 405. 

S. Garribba, L. Quartapelle and G. Reina, Algorithm 36. SNIFF: Efficient self-tuning 
algorithm for numerical integration, Computing, 20 (1978), 363-375. 

J. Garloff, W. Solak and Z. Szydelko, New integration formulas which use nodes 
outside the integration interval, J. Franklin Inst., 321 (1986), 115-126. 

L. Gatteschi, On some orthogonal polynomial integrals, Math. Comp., 35 (1980), 1291- 
1298. 

C. F. Gauss, Werke,, vol. . 3,, 1866, pp. 163-196. 

W. Gautschi, Construction of Gauss-Christ off el quadrature formulas, Math. Comp., 22 
(1968a), 251-270. 

_, Algorithm 331: Gaussian quadrature Formulas [D 1], Comm. ACM 11 (1968b), 

432-436. 

_, On the condition of a matrix arising in the numerical inversion of the Laplace 

transform, Math. Comp., 23 (1969), 109-118. 

_, On the construction of Gaussian rules from modified moments, Math. Comp., 24 

(1970), 245-260. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


563 


_, Quadrature formulae on half-infinite intervals, BIT, 31 (1991a), 438-446. 

_, On the remainder term for analytic functions of Gauss-Lobatto and Gauss-Radau 

quadratures, Rocky Mountain J., 21 (1991b), 209-226; correction, Rocky Mountain J., 
21 (1991), 1143. 

_, On the computation of generalized Fermi-Dirac and Bose-Einstein integrals, Corn- 

put. Phys. Comm., 74 (1993), 233-238. 

_, Gauss-type quadrature rules for rational functions, in Numerical Integration IV 

(H. Brass and G. Hammerlin, eds.), Birkhauser, Basel, 1993a, pp. 110-130. 

_, On the computation of generalized Fermi-Dirac and Bose-Einstein integrals, Com- 

mut. Phys. Communi., 74 (1993b), 233-238. 

_, Algorithm 726: ORTHPOL- A package of routines for generating orthogonal poly¬ 
nomials and Gauss-type quadrature rules, ACM Trans. Math. Software, 20 (1994), 
21-62. 

_, Remark on Algorithm 726: ORTHPOL — A package of routines for generating 

orthogonal polynomials and Gauss-type quadrature rules, ACM Trans. Math. Software, 
24 (1998), 355-358. 

_, Algorithm 793: GQRAT — Gauss quadrature for rational functions, ACM Trans. 

Math. Software, 25 (1999), 213-239. 

_and S. Li, The remainder term for analytic functions of Gauss-Radau and Gauss- 

Lobatto quadrature rules with multiple end points, J. Comp. Anal. Math., 33 (1990), 
315-329. 

_and R. S. Varga, Error bounds for Gaussian quadrature of analytic functions, 

SIAM J. Numer. Math., 20 (1983), 1170-1186. 

_and J. Wimp, Computing the Hilbert transform for a Jacobi weight function, BIT, 

27 (1987), 203-215. 

W. M. Gentleman, Implementing Clenshaw-Curtis quadrature, I. Methology and experi¬ 
ence, Comm. ACM, 15 (1972a), 337-342; 343-346. 

_, Implementing Clenshaw-Curtis quadrature, II. Computing the cosine transforma¬ 
tion, Comm. ACM, 15 (1972b), 343-346. 

_, Algorithm 424: Clenshaw-Curtis quadrature, Comm. ACM, 15 (1972c), 353-355. 

A. Genz and A. A. Malik, An imbedded family of fully symmetric numerical integration 
rules, SIAM J. Numer. Anal., 20 (1983), 580-588. 

C. F. Gerald and P. O. Wheatley, Applied Numerical Analysis, 5th ed., Addison-Wesley, 
Reading, MA, 1970. 

A. Gerasoulis, Nystrom’s iterative variant methods for the solution of Cauchy singular 
integral equations., SIAM J. Numer. Anal., 26 (1989), 430. 

_and R. P. Srivastav, On the solvability of singular integral equations via Gauss- 

Jacobi quadrature, BIT, 21 (1982), 377-380. 

_, Piecewise-polynomial quadratures for Cauchy singular integrals, SIAM J. Numer. 

Anal., 23 (1986), 891-902. 

Ia. L. Geronimus, On Gauss’ and Chebychev’s quadrature formulas, Doklady Akad. Nauk 
SSSR, 51 (1946), 655-658. (Russian) 

_, Theory of Orthogonal Polynomials, Gostekhizdat, Moscow, 1950. 

A. Ghizzetti, Procedure for constructing quadrature formulae on infinite intervals, Numer. 
Math., 12 (1968), 111-119. 

_and A. Ossicini, Quadrature Formulae, Birkhauser, Basel, 1970. 

P. E. Gill and G. F. Miller, An algorithm for the integration of unequally spaced data, 
Comput. J., 15 (1972), 80-83. 

G. Giunta and A. Murli, Algorithm 649: A package for computing trigonometric Fourier 
coefficients based on Lyness’s algorithm, ACM Trans. Math. Software, 13 (1987), 97- 
107. 

_, G. Laccetti and M. R. Rizzardi, More on Weeks method for the numerical 

inversion of the Laplace transform, Numer. Math., 54 (1988), 193-200. 


2005 by Chapman & Hall/CRC Press 



564 


BIBLIOGRAPHY 


_,G. Giunta, J. N. Lyness, and A. Murli, Algorithm 662, A FORTRAN software 

package for the numerical inversion of the Laplace transform based on Weeks’ method, 
ACM Trans. Math. Software, 14 (1988b), 171-176. 

I. S. Gladshteyn and I. M. Ryzik, Tables of Integrals, Series, and Products , Academic 
Press, New York, 1965. 

I. Gladwell, Vectorization of one-dimensional quadrature codes , in Numerical Integration 
— Recent Developments, Software and Applications (P. Keast and G. Fairweather, 
eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 231-238. 

M. A. Golberg and C. S. Chen, Discrete Projection Methods for Integral Pquations, 
CMP, Southampton and Boston, 1997. 

M. A. Goldberg, Initial value methods in the theory of Fredholm integral equations , J. 
Optim. and Appls., 9 (1972), 112-119. 

_, Convergence of an initial value method for solving Fredholm integral equations , J. 

Optim. and Appls., 12 (1973), 334-356. 

_, The conversion of Fredholm integral equations to equivalent Cauchy problems, 

Appl. Math, and Comput., 2 (1976), 1-18. 

_, The conversion of Fredholm integral equations to equivalent Cauchy problems — 

Computation of resolvents, Appl. Math, and Comput., 3 (1977). 

_, Boundary and initial-value methods for solving Fredholm equations with semide¬ 
generate kernels , J. Optim. Theory and Appls., 24 (1978). 

_(ed.), Solution Methods for Integral Equations , Plenum Press, New York, 1979. 

_, A method of adjoints for solving some ill-posed equations of the first kind , J. Appl. 

Math, and Comput., 5 (1979), 123-130. 

G. H. Golub and J. H. Walsh, Calculation of Gauss quadrature rules , Math. Comput., 
23 (1969), 221-230. 

E. A. Gonzales-Velasco, Fourier Analysis and Boundary Value Problems , Academic 
Press, San Diego, CA, 1995. 

R. F. Goodrich and F. Stenger, Movable singularities and quadrature , Math. Comp., 24 
(1970), 283-300. 

E. T. Goodwin, The evaluation of integrals of the form f(x) e~ x dx, Proc. Cambr. 
Philos. Soc., 45 (1949), 241-245. 

E. Goursat, Determination de la resolvante d’une equation Volterra , Bull, des Scs. et 
Math. 57 (1933), 144-150. 

_, Cours d’Analyse Mathematique, III , 5th ed., Gauthier-Villars, Paris, 1934; Dover, 

New York, 1964. 

A. Graps, An introduction to wavelets , IEEE Comput. Sc. Engg., 2 (1995). 

H. L. Gray and S. Wang, A new method for approximating improper integrals , SIAM J. 
Numer. Anal., 29 (1992), 271-283. 

P. B. Gridamo, The transient temperature field in a composite semi-space resulting from 
an incident heat flux, Quart. Appl. Math., 31 (1974), 379-393. 

C. W. Groetsch, The Theory of Tikhonov Regularization for Fredholm Integral Equations 
of the First Kind, Pitman Advanced Publishing Program, Boston, 1984. 

A. Grossmann and J. Morlet, Decomposition of Hardy functions into square integrable 
wavelets of constant shape, SIAM J. Math., 15 (1984), 723-736. 

R. B. Guenther and E. L. Roetmann, Newton-Cotes formulas in n dimensions, Num. 
Math., 14 (1970), 330-345. 

M. Guiggiani, The evaluation of Cauchy principal value integrals in the boundary element 
method — A Review, Math. Comput. Modelling, 15 (1991), 175-184. 

S. -A. Guastfson, Rapid computation of weights of interpolatory quadrature rules, CACM, 

14 (1971), 807. 

A. Haar, Zur Theorie der orthogonalen Funktionensystems, Math. Ann., 69 (1910), 331- 
371. 

S. Haber, Indefinite integration formulas based on the sine expansion, in Numerical In- 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


565 


tegration — Recent Developments, Software and Applications (P. Keast and G. Fair- 
weather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 105-106. 

W. Hackbusch, Multigrid Methods and Applications , Springer-Verlag, Berlin, 1985. 
_, Integral Equations , Birkhauser, Boston, 1995. 

J. Hadamard, Lectures on Cauchy’s Problem in Linear Partial Differential Equations, 
Yale Univ. Press, New Haven, 1923. 

D. F. Haines, Numerical Inversion of Laplace Transforms and Applications , M.S. Thesis, 

University of New Orleans, New Orleans, LA, May 1982. 

O. T. Hanna and L. F. Brown, A new method for the numerical solution of Fredholm 
integral equations of the first kind , Chemical Engg. Soc., 46 (1991), 2749-2753. 

P. C. Hammer, O. J. Marlowe and A. H. Stroud, Numerical integration over simplexes 

and cones , Math. Tables Aids Comput., 10 (1956), 130-137. 

_and A. W. Wymore, Numerical evaluation of multiple integrals I, Math. Tables 

Aids Comput., 11 (1957), 59-67. 

_ and H. H. Wicke, Quadrature formulas involving derivatives of the integrand, 

Math. Comp., 14 (1960), 3-7. 

P C Hansen, Numerical tools for analysis and solution of Fredholm integral equations of 
the first kind , Inverse Problems, 8 (1992), 849-887. 

C. G. Harris and W. A. B. Evans, Extension of numerical quadrature formulae to cater 
for end-point singular behaviour over finite intervals , Int. J. Comp. Math., 6 (1977), 
219-227. 

T. Hasegawa and T. Torii, An automatic quadrature for Cauchy principal value integrals, 
Math. Comp., 56 (1991), 741-754. 

_and T. Torii, Hilbert and Hadamard transforms by generalized Chebyshev expan¬ 
sion, J. Comput. Appl. Math., 51 (1994), 71-83. 

A. Hausner, NL9 — An adaptive routine for numerical quadrature, Proc. 1977 Army 
Numer. Anal. Comput. Conf., (1977), 367-410. 

_and J. D. Hutchison, FOG IE: An adaptive code for numerical integrals using 

Gaussian quadrature, Proc. 1975 Army Numer. Anal. Comput. Conf., (1975), 139-177. 
P. Henrici, Elements of Numerical Analysis, Wiley, New York, 1964. 

E. Hernandez and G. Weiss, A First Course on Wavelets, CRC Press, Boca Raton, FL, 

1996. 

J. H. Hetherington, An error bound for quadrature, Math. Comput., 26 (1972), 695-698. 
J. Heinhold, Einige mittels Laplace-Transformation losbare Integralgleichungen, I, Math. 
Z., 52 (1950), 779-790. 

P. Henrici, Elements of Numerical Analysis, Wiley, New York, 1964. 

R. B. Hetnarski, On inverting the Laplace transforms connected with the error function, 
Zastowania Matem, 7 (1964), 399-405. 

_, An algorithm for generating some inverse Laplace transforms of exponential form, 

ZAMP, 26 (1975), 249-254. 

F. B. Hildebrand, Introduction to Numerical Analysis, McGraw-Hill, New York, 1956; 

2nd ed., 1974, pp. 389. 

H. Hochstadt, Integral Equations, John Wiley, New York, 1973. 

G. Honig and U. Hirdes, A method for the numerical inversion of Laplace transforms, J. 

Comput. Appl. Math., 10 (1984), 113-132. 

T. H. Hopp, A routine for numerical evaluation of integrals with oscillatory integrands, 
Proc. 1977 Army Numer. Anal. Comput. Conf., (1979), 187-221. 

R. W. Hornbeck, Numerical Methods, Quantum Publishers, New York, 1975. 

C. B. Huelsman, III, Quadrature formulae over fully symmetric planar regions, SIAM J. 

Numer. Anal., 10 (1973), 539-552. 

J. Humlecek, An efficient method for evaluation of complex probability integral: the Voigt 
function and its derivatives, J. Quart. Spectros. Radiol. Tansfer, 121 (1979), 309-313. 

D. B. Hunter, The evaluation of integrals of periodic analytic functions, BIT, 11 (1971), 


2005 by Chapman & Hall/CRC Press 



566 


BIBLIOGRAPHY 


175-180. 

_, Some error expansions for Gaussian quadrature, BIT, 35 (1995), 64-82. 

_, The numerical evaluation of definite integrals affected by singularities near the 

interval of integration, in Numerical Integration — Recent Developments, Software and 
Applications (T. O. Espelid and A. Genz, eds.), Kluwer, Dordrecht, 1992, pp. 111-120. 

_and G. E. Okecha, A modified Gaussian quadrature rule for integrals involving 

poles of any order , BIT, 26 (1986), 233-240. 

_and G. Nikolov, Gauss-Lobatto quadrature formulas associated with symmetric 

weight functions, Math. Comp., 69 (1999), 269-282. 

B. Hupper and E. Pollak, Numerical inversion of the Laplace transform, J. Chem. Phys., 

110 (1999), 11176-11186. 

H. Hurwitz and P. F. Zweifel, Numerical quadrature of Fourier transform integrals, 
MTAC, 10 (1956), 140-149. 

_, R,. A. Pfeifer and P. F. Zweifel, Numerical quadrature of Fourier transform 

integrals,II, MTAC, 13 (1959), 89-90. 

C. Hwang and M.-J. Lu, Improved FFT-based numerical inversion of Laplace transforms 

via fast Hartley transform algorithm, Computers Math. Applic., 22 (1991), 13-24. 
IBM, System/360 Scientific Subroutine Package, Version III. Programmer’s Manual H20- 
0205-3, 1968. 

J. P. Imhof, On the method for numerical integration of Clenshaw and Curtis, Numer. 
Math., 5 (1963), 138-141. 

H. Inoue, M. Kamibayashi, K. Kishimoto, T. Shubiya and T. Koizumi, Numerical 
Laplace transformation and inversion using fast Fourier transform, JSME Intern. J., 
Ser. I, 35 (1992), 319-324. 

N. I. Ioakimidis, On the uniform convergence of Gaussian quadrature rules for Cauchy 
principal value integrals and their derivatives, Math. Comp., 44 (1985), 191-198. 

_, Mangier-type principal value integrals in hypersingular integral equations for crack 

problems in plane elasticity, Engg. Frac. Mech., 31 (1988), 895-898. 

_, Application of computer algebra software to the derivation of numerical integra¬ 
tion rules for singular and hypersingular integrals, in Numerical Integration — Recent 
Developments, Software and Applications (T. O. Espelid and A. Genz, eds.), Kluwer, 
Dordrecht, 1992, pp. 121-131. 

_and P. S. Theocaris, On the numerical evaluation of Cauchy principal value in¬ 
tegrals, Rev. Roumaine Sci. Tech. Ser. Mec. Appl., 22 (1977), 803-818. 

M. Iri, S. Moriguti, and Y. Takasawa, On a certain quadrature formula, Kokyuroku of 
the research Inst, for Math. Scs., Kyoto Univ., 91 (1970), 82-118. (Japanese) 

M. A. Jawson, Integral equation methods in potential theoty, I, Proc. Royal Soc., A 275 
(1963), 23-32 (for part II, see G. T. Symm). 

E. Isaacson and H. B. Keller, Analysis of Numerical Methods, Wiley, New York, 1966. 
E. Jen and R. P. Srivastav, Solving singular integral equations using Gaussian quadrature 
and overdetermined systems, Comp. & Maths, with Appls., 9 (1983), 625-632. 

A. J. Jerri, Integral and Discrete Transforms with Applications and Error Analysis, Vol. 

162, Monograph Textbooks Pure Appl. Math., Maecel Dekker, New York, 1992. 

B. Jones, A note on the T transformation, Nonlinear Analysis: Theory, Methods and 
Applications, 6 (1982), 303-305. 

L. W. Johnson and R,. D. Riess, Minimal quadratures of low order continuity, Math. 
Comput., 25 (1971), 832-835. 

_and R. D. Riess, Numerical Analysis, Addison-Wesley, Reading, MA, 1977. 

_, R. D. Riess, and J. T. Arnold, Introduction to Linear Algebra, 2nd ed., Addison- 

Wesley, Reading, MA, 1993. 

W. W. Johnson, On Cotesian numbers: their history, computation and values, Quart. J. 
Pure Appl. Math., 46 (1915), 52-65. 

P. M. Jordan, P. Puri, and G. Boros, A new class of Laplace inverses and their appli- 


2005 by Chapman & Hall/CRC Press 












BIBLIOGRAPHY 


567 


cations, Applied Math. Letters, 13 (2000), 97-104. 

_,M. R. Meyer, and A. Puri, Causal implications of viscous damping in compress¬ 
ible fluid flows, Physical Review, E, 62 (2000), 7981-7926. 

H. Kabir, E. Madenci, and A. Ortega, Numerical solution of integral equations with 
logarithmic-, Cauchy- and Hadamard-type singularities, Inti. J. Numer. Methods in 
Engg., 41 (1998), 617-638. 

H. Kadner, Die numerische Behandlung von Integralgleichungen nach der Kollokations- 
methode, Numer. Math. 10 (1967), 241-261. 

D. K. Kahaner, Comaprison of numerical quadrature formulae, in Mathematical Software 
(J. R. Rice, eds.), ACM Monograph Series, Academic Press, London, 1971, pp. 229-259. 

_, Numerical quadrature by the e-algorithm, Math. Comp., 26 (1972), 689-693. 

_M. Klerer and F. Grossman, Error rates in tables of indefinite integrals, Indust. 

Math., 18 (1968), 31-62. 

_and G. Monegato, Nonexistence of extended Gauss-Laguerre and Gauss-Hermite 

quadrature rules with positive weights, ZAMP, 29 (1978), 983-986. 

_, Development of useful quadrature software with particular emphasis on microcom¬ 
puters, in Numerical Integration — Recent Developments, Software and Applications 
(P. Keast and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, 
pp. 343-369. 

G. Kaiser, A Friendly Guide to Wavelets, Birkhauser, Boston, 1994, pp. 44-45. 

J. Kajiwara and M. Tsuji, Inverse formula for Laplace transform, 5th Intern. Colloq. on 
Diff. Eqs (D. Bainov and V. Covachev, eds.), VSP, 1995, pp. 163-173. 

_and M. Tsuji, Program for the numerical analysis of inverse formula for Laplace 

transform, Second Korean-Japanese Colloq. on Finite or Infinite Complex Analysis 
(1995), 93-107. 

A. I. Kalandiya, Mathematical Methods for Two-Dimensional Elasticity, Mir Pubis., 
Moscow, 1973. 

D. W. Kammler, A First Course in Fourier Analysis, Prentice Hall, Upper Saddle River, 
NJ, 2000. 

H. Kaneko, A projection method for solving Fredholm integral equations of the second kind, 

Trans. Appl. Numer. Math., 5 (1989), 333. 

_and Y. Xu, Numerical solutions for weakly singular Fredholm integral equations of 

the second kind, Trans. Appl. Numer. Math., 7 (1991), 167-177. 

_and R. Noren, An application of approximation theory to numerical solutions for 

Fredholm integral equations of the second kind, Numer. Functional Anal. Optim., 5 
(1992), 517. 

_, R. D. Noren, and Y. Xu, Numerical solutions for weakly singular Hammerstein 

equations and their superconvergence, J. Integral Eqns. Appls., 4 (1992), 391. 

R. P. Kanwal, Linear Integral Equations, Academic Press, New York, 1971. 

_, Linear Integral Equations, Birkhauser, Boston, 1997. 

L. V. Kantorovich and V. I. Krylov, Approximate Methods for Higher Analysis, Inter¬ 
science, New York, 1958. 

_and G. P. Akilov, Functional Analysis in Normed Spaces, Pergamon Press, Oxford, 

1964. 

J. Kautsky and S. Elhay, Calculation of the weights of interpolatory quadratures, Numer. 
Math., 40 (1982), 407-422. 

A. C. Kaya and F. Erdogan, On the solution of integral equations with strongly singular 
kernels, Quarterly Appl. Math., 45 (1987), 105-122. 

P. Keast and J. N. Lyness, On the structure of fully symmetric multidimensional quad¬ 
rature rules, SIAM J. Numer. Anal., 16 (1979), 11-29. 

_and G. Fairweather (eds.), Numerical Integration — Recent Developments, Soft¬ 
ware and Applications, D. Reidel, Dordrecht, the Netherlands, 1987. 

C. T. Kelley, Solution of the Chandrasekhar H-equation by Newton’s method, J. Math. 


2005 by Chapman & Hall/CRC Press 



568 


BIBLIOGRAPHY 


Phys., 21 (1982), 1625-1628. 

_, A fast multilevel algorithm for integral equations, SIAM J. Numer. Anal., 32 

(1995), 501-513. 

J. T. King, Introduction to Numerical Computation , McGraw-Hill, New York, 1984. 

K. Knopp, Theory and Applications of Infinite Series , Blackie & Son, Ltd., London, 1928. 
J. Kondo, Integral Equations , Kodansha, Tokyo, and Clarendon Press, Oxford, 1991. 

Z. Kopal, Numerical Analysis , 2nd ed., Wiley, New York, 1961. 

G. Kowalewski, Interpolation und Genahrte Quadrature Teubner, Leipzig, 1932. 

W. Kramer and S. Wender, Two adaptive Gauss-Legendre type algorithms for the verified 
computation of definite integrals , Reliable Computing, 2 (1996), 241-254. 

H. L. Krall and O. Frink, A new class of orthogonal polynomials , Trans. Amer. Math. 

Soc., 65 (1949), 100-145. 

S. Krenk, On quadrature formulas for singular integral equations of the first and second 
kind , Quart. Appl. Math., (Oct. 1975), 225-232. 

_, Quadrature formulas of closed type for the solution of singular integral equations, 

J. Inst. Math. Appl., 22 (1978), 99-107. 

R. Kress, Linear Integral Equations , Springer-Verlag, Berlin, 1989. 

_, I. Sloan, and F. Stenger, A sine quadrature method for the double-layer integral 

equation in planar domains with corners, J. Integral Eqns. Appl., 10 (1998), 291-317. 
A. S. Kronrod, Nodes and Weights of Quadrature Formulas, Consultants Bureau, New 
York, 1965. 

F. T. Krogh and W. Van Snyder, Algorithm 699: A new representation of Patterson’s 

quadrature formulae, ACM Trans. Math. Software, 17 (1991), 457-461. 

V. I. Krylov, Approximate Calculation of Integrals (Russian); English transl. by A. Stroud, 
Macmillan, New York, 1962. 

_, V. V. Lugin and L. A. Yanavich, Tables of Numerical Integration for f* (1 - 

x) a f(x) dx, Akademiya Nauk Belorusskoi S. S. R., Minsk, 1963 (Russian). 

_and L. G. Kruglikova, Handbook on Numerical Harmonic Analysis, Nauka i 

Tekhnika, Minsk, 1968 (Russian). 

_and N. S. Skoblya, On the numerical inversion of the Laplace transform, Inzh.-Fiz. 

Zh., 4 (1961), 85-101. (Russian) 

_and A. A. Pal’tsev, Tables for Numerical Integration of Functions with Loga¬ 
rithmic and Power Singularities, Israel Program for Scientific Translation, Jerusalem, 
1974. 

_and N. S. Skoblya, A Handbook of Numerical Inversion of Laplace Transforms, 

Mir Publishers, Moscow, 1977. 

E. Kreyszig, Introductory Functional Analysis with Applications, John Wiley, New York, 
1978. 

P. K. Kulshrestha and P. Puri, An exact solution of hydromagnetic boundary layer in 
a rotating medium, Proc. 11th Midwestern Mech. Conf., Developments in Mech., 5 
(1969), 265-271. 

G. F. Kuncir, Algorithm 103. Simpson’s rule integrator, Comm. ACM, 5 (1962), 347. 

S. S. Kuo, Computer Applications of Numerical Methods, Addison-Wesley, Reading, MA, 

1972. 

R. D. Kurtz, T. N. Farris, and C. T. Sun, The numerical solution of Cauchy singular 
integral equations with application of fracture, Inti. J. Fracture, 66 (1994), 139. 

H. R. Kutt, Quadrature Formulas for Finite-Part Integrals, Special Report WISK, 178, 
National Research Institute for Mathematical Sciences, Pretoria, South Africa (1975). 

_, On the numerical evaluation of finite-part integrals involving an algebraic singu¬ 
larity, CSIR Special Report WISK, Pretoria, 179 (1976). 

_, On the numerical evaluation of principal value integrals by finite-part integration, 

Numer. Math., 24 (1975), 205-210. 

_, Gaussian quadrature formulae for improper integrals involving a logarithmic sin- 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


569 


gularity, CSIR Special Report WISK, Pretoria, 1232 (1976). 

P. K. Kythe, An Introduction to Boundary Element Methods, CRC Press, Boca Raton, 
FL, 1995. 

_, Fundamental Solutions for Differential Operators and Applications, Birkhauser, 

Boston, 1996. 

_, Computational Conformal Mapping, Birkhauser, Boston, 1998. 

_P. Puri and M. R. Schaferkotter, Partial Differential Equations and Mathematica, 

CRC Press, Boca Raton, FL, 1997. 

_and P. Puri, Computational Methods for Linear Integral Equations, Birkhauser, 

Boston, 2002. 

_P. Puri and M. R. Schaferkotter, Partial Differential Equations and Boundary Value 

Problems with Mathematica, CRC Press, Boca Raton, FL, 2002. 

_and D. Wei, An Introduction to Linear and Nonlinear Finite Element Analysis, 

Birkhauser, Boston, 2004. 

G. Laccetti, The incidental parameters of a numerical method for inverting a Laplace 
transform function, Richerche di Matem., 41 (1992), 163-184. 

C. Lanczos, Applied Analysis, Prentice-Hall, Englewood Cliffs, NJ, 1956. 

P. J. Laurent, Formules de quadrature approchee sur domines rectangulaires convergentes 
pour toute fonction integrable Riemann, C. R. Acad. Sci. Paris, 258 (1964), 798-801. 

D. P. Laurie, Sharpoer error estimates in adaptive quadrature, BIT, 23 (1983), 256-261. 

_, Null rules and orthogonal expansions, in Approximation and Computation: A 

Festschrift in Honor of Walter Gautschi (R. V. M. Zahar, eds.), Vol. 119 of Internatal 
Ser. Numer. Math., Birkhauser, Boston, 1994, pp. 350-370. 

_and L. Rolfes, Algorithm 015. Computation of Gaussian quadrature rules from 

modified moments, J. Comput. Appl. Math., 5 (1979), 235-242. 

_and A. Venter, Automatic Quadrature of Functions of the Form \f(x)\, Technical 

Note T/15, Potchefstroom University, 1993. 

M. M. Lavrentiev, Some Improperly Posed Problems of Mathematical Physics, Springer- 
Verlag, New York, 1967. 

D. Lazard and R. Rioboo, Integration of rational functions — Rational computation of 
the logarithmic part, J. Symbolic Comput., 9 (1990), 113-115. 

F. Lether, Modified quadrature formulas for functions with nearby poles, J. Comp. Appl. 
Math., 3 (1977), 3-9. 

_, Analytical expansions for the numerical approximation of the Fermi-Dirac integrals 

Fj(x) of order j = -1/2 and j = 1/2, J. Sci. Comput., 15 (2000), 479-497. 

_, Variable precision algorithm for the numerical computation of the Fermi-Dirac 

function Fj(x) of order j = —3/2, J. Sci. Comput., 16 (2001), 69-79. 

D. Levin, Development of non-linear transformations for improving convergence of se¬ 
quences, Int. J. Comp. Math., 3 (1973), 371-388. 

_, Numerical inversion of Laplace transforms by accelerating the convergence of 

Bromwich’s integrals, J. Comp. Appl. Math., 1 (1975), 247-257. 

_, Procedures for computing one and two dimensional integrals of functions with 

rapid irregular oscillations, Math. Comp., 38 (1982), 531-538. 

_and A. Sidi, Two new classes of non-linear transformations for accelerating the 

convergence of infinite integrals and series, Appl. Math. Comp., 9 (1981), 175-215. 

N. Levinson, Simplified treatment of integrals of Cauchy type, the Hilbert problem and 
singular integral equations, SIAM Rev., 7 (1965), 474-502. 

S. Lewanowicz, Construction of a recurrence relation for modified moments, J. Comp. 
Appl. Math., 5 (1979), 193-206. 

_, Recurrence relations for modified moments, Rev. T’ec. Ing., Univ. Zulia, 8 (1985), 

49-60. 

M. J. Lighthill, Fourier Analysis and Generalized Functions, Cambridge Univ. Press, 
Cambridge, 1959. 


2005 by Chapman & Hall/CRC Press 




570 


BIBLIOGRAPHY 


P. Linz, Numerical methods for Volterra integral equations of the first kind, Comput. J., 
12 (1969), 393-397. 

_, Product integration methods for Volterra integral equations of the first kind , BIT, 

11 (1971), 413-421. 

_, Algorithm 427. Fourier cosine integral, Comm. ACM, 15 (1972), 358-360. 

_, An analysis of a method for solving singular integral equations, BIT, 17 (1977), 

329-337. 

_, Analytical and numerical methods for Volterra equations, SIAM Stud. Appl. Math., 

1985. 

_, Bounds and estimates for condition numbers of integral equations, SIAM J. Numer. 

Anal., 28 (1991), 227. 

R. Lipow and F. Stenger, How slowly can quadrature formulae converge?, Math. Corn- 
put., 26 (1972), 917-922. 

J. E. Littlewood and R. E. A. C. Paley, Theorems on Fourier series and power series, 
I, J. London Math. Soc., 6 (1931), 230-233. 

_and R. E. A. C. Paley, Theorems on Fourier series and power series, II, Proc. 

London Math. Soc., 42 (1936), 52-89. 

F. Locher and K. Zeller, Approximations gute und numerische Integration, Math. Zeit., 
104 (1968), 249-251. 

I. M. Longman, A method for the numerical evaluation of finite integrals of oscillatory 

functions, Math. Comp., 14 (1960), 53-59. 

W. V. Lovitt, Linear Integral Equations, Dover, New York, 1950. 

D. W. Lozier, Numerical solution of linear difference equations, Report NBSIR 80-1976 
(1980), National Bureau of Standards, Washington, D.C. 

_L. C. Maximon and W. L. Sadowski, A bit comparison program for algorithm 

testing, Comput. J., 16 (1973), 111-117. 

J. Lu, A class of quadrature formulas of Chebyshev type for singular integrals, J. Math. 

Anal. Appl. (2), 100 (1984), 416-435. 

D. S. Lubinsky and P. Rabinowitz, Rates of convergence of Gaussian quadrature for 
singular integrands, Math. Comp., 43 (1984), 219-242. 

_and A. Sidi, Convergence of product integration rules for functions with interior 

and endpoint singularities, Math. Comp., 46 (1986), 229-245. 

Y. L. Luke, Integrals of Bessel Functions, McGraw-Hill, New York, 1962. 

_, Approximations of elliptic integrals, Math. Comp., 22 (1968), 627-634. 

_, The Special Functions and Their Approximations, Vol. 2, Academic Press, New 

York, 1969, pp. 255-269. 

J. Lund, Sine function quadrature rules for the Fourier integral, Math. Comp., 41 (1983), 
103-113. 

_and K. L. Bowers, Sine Methods for Quadrature and Differential Equations, SIAM, 

Philadelphia, 1992. 

J. N. Lyness, The effect of inadequate convergence criteria in automatic routines, Com¬ 
puter J., 12 (1969), 279-281. 

_, Algorithm 379. SQUANK (Simpson quadrature used adaptively — Noise killed), 

Comm. ACM, 13 (1970), 260-263;15 (1972), 1073. 

_, When not to use an automatic quadrature routine, SIAM Rev., 25 (1983), 63-87. 

_, Notes on the adaptive Simpson quadrature routine, J. ACM, 16 (1969), 483-495. 

_, Guidelines for Automatic Quadrature Routines, in Information Processing 71 (C. 

V. Freeman et ah, eds.), vol. 2, North-Holland, Amsterdam, 1972. 

_, Computational techniques based on Lanczos representation, Math. Comp., 28 

(1974), 81-123. 

_, The calculation of trigonometric Fourier coefficients, J. Comp. Phys., 54 (1984), 

57-73. 

_, Some quadrature rules for finite trigonometric and related integrals, in Numeri- 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


571 


cal Integration — Recent Developments, Software and Applications (P. Keast and G. 
Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 17-34. 

_, Finite-part integrals and the Euler-Maclaurin expansion , in Approximation and 

Computation: A Festschrift in Honor of Walter Gautschi (R. V. M. Zahar,, eds.), Vol. 
119 of Internatal Ser. Numer. Math., Birkhauser, Boston, 1994, pp. 397-407. 

_and E. deDoncker, On quadrature error expansions, I, J. Comp. Appl. Math., 17 

(1987), 131-149. 

_and E. deDoncker, On quadrature error expansions, II — The full corner singu¬ 
larity , Numer. Math., 64 (1993), 355-370. 

_and G. Giunta, A modification of the Weeks method for the numerical inversion 

of Laplace transforms , Math. Comput., 47 (1986), 313-322. 

_ and D. Jespersen, Moderate degree symmetric quadrature rules for the triangle , J. 

Inst. Math. Appl., 15 (1975), 19-32. 

_ and B. W. Ninham, Numerical quadrature and asymptotic expansions , J Math. 

Comp., 21 (1967), 162-178. 

A. J. MacLeod, Algorithm 119: Fermi-Dirac functions of order —1/2,1/2, 3/2, 5/2, ACM 
Trans. Math. Soft., 24 (1998), 1-12. 

M. A. Malcolm and R. B. Simpson, Local versus global strategies for adaptive quadrature, 
ACM Trans. Math. Software, 1 (1975), 129-146. 

S. Mallet, Multiresolution approximations and wavelet orthonormal bases for L 2 (R ), 
Trans. Amer. Math. Soc., 315 (1989a), 60-87. 

_, A theory of multiresolution signal decomposition: the wavelet representation , IEEE 

Trans. Pattern Anal. Machine Intell., 11 (1989b), 674-693. 

J. T. Marti, Introduction to the Theory of Bases, Springer-Verlag, Berlin, 1969. 

H. Marvar, Lapped transforms for efficient transform/subband coding, IEEE Trans. Acous¬ 
tics Speech Signal and Processing, 38 (1990), 969-978. 

G. Mastroianni and G. Mogenato, Polynomial approximations of functions with end¬ 
point singularities and product integration formulas, Math. Comp., 62 (1994), 725-738. 

_and S. Prossdorf, Some nodes matrices appearing in the numerical analysis for 

singular integral equations, BIT, 34 (1994), 120. 

_and G. Mogenato, Convergence of product integration rules over (0, oo) for func¬ 
tions with weak singularities at the origin, Math. Comp., 64 (1995), 237-249. 

N. W. McLachlan, Complex Variables and Operational Calculus, 2nd ed., Macmillan, 
New York, 1953. 

J. McNamee, Error-bounds for the evaluation of integrals by the Euler-Maclaurin formula 
and by Gauss-type formulae, Math. Comp., 18 (1964), 368-381. 

_, A program to integrate a function tabulated at unequal intervals, Intern. J. Numer. 

Methods in Engg., 17 (1981), 271-279. 

W. S. Meisel, A numerical integration formula useful in Fourier analysis, Commun. ACM, 
11 (1968), 51. 

Y. Meyer, Wavelets and Operators, (Translation from ‘Ondelettes et Operateurs.I: Her¬ 
man, Paris, 1990), Cambridge Univ. Press, 1992. 

_, Wavelets, Algorithms and Applications, SIAM, 1993. 

C. A. Micchelli and T. J. Rivlin, Numerical integration rules near Gaussian quadrature, 
Israel J. Math., 16 (1973), 287-299. 

G. Miel, Parallel solution of Fredholm integral equations on the second kind by orthogonal 
polynomial expansions, Trans. Appl. Numer. Math., 5 (1989), 345. 

S. G. Mikhlin, Integral Equations, Pergamon Press, Oxford, 1957. 

_, Linear Integral Equations, Hindustan Publ. Corp., Delhi, 1960. 

_, Linear Equations of Mathematical Physics, Holt, Reinhart and Winston, New 

York, 1967. 

_, The Numerical Performance of Variational Methods, Noordhoff, Gronin-gen, 1971; 

from Russian. 


2005 by Chapman & Hall/CRC Press 



572 


BIBLIOGRAPHY 


_and K. L. Smolitskiy, Approximate Methods for Solution of Differential and Inte¬ 
gral Equations, American Elsevier Publishing Co. Inc., New York, 1967. 

E. K. Miller, A variable interval width quadrature technique based on Romberg’s method, 
J. Comput. Phys., 5 (1970), 265-279. 

J. C. P. Miller, Quadrature in terms of equally spaced function values, Tech. Summary 
Rep. 167, Math. Res. Center, Madison, WI, 1960. 

M. Miller and W. T. Guy, Jr., Numerical inversion of the Laplace transform by the use 
of Jacobi polynomials, SIAM J. Numer. Anal., 3 (1966), 624-635. 

R. K. Miller, On ignoring the singularity in numerical quadrature, Math. Comp., 25 
(1971), 521-532. 

M. Misiti, Y. Misiti, G. Oppenheim and J.-M. Poggi, Wavelet Toolbox, Version 2, The 
MathWorks, Natick, Ma, 1997-2000. 

J. L. Mohamed and J. E. Walsh, Numerical Algorithms, Clarendon Press, Oxford, 1986. 

G. Monegato, A note on extended Gaussian quadrature rules, Math. Comp., 30 (1976), 
812-817. 

_, Stieltjes polynomials and related quadrature rules, SIAM Rev., 24 (1982), 137-158. 

_, Quadrature formulas for functions with poles near the interval of integration, 

Math. Comp., 47 (1986), 301-312. 

_, Quadrature formulas for functions with poles near the interval of integration, 

Math. Comp., 47 (1986), 301-312. 

_, On the weights of certain quadratures for the numerical evaluation of Cauchy 

principal value integrals and their derivatives, Numer. Math., 50 (1987), 273-281. 

_, On the weights of certain quadratures for the numerical evaluation of Cauchy 

principal value integrals and their derivatives, Numer. Math., 50 (1987), 273-281. 

_, The numerical evaluation of a 2 -D Cauchy principal value integral arising in 

boundary integral equation method, Math. Comp., 62 (1994), 765-777. 

_, Numerical evaluation of hypersingular integrals, J. Comput. Appl. Math., 50 

(1994), 9-31. 

_, The numerical evaluation of a 2 -D Cauchy principal value integral arising in 

boundary integral equation method, Math. Comp., 62 (1994), 765-777. 

_, Numerical evaluation of hypersingular integrals, J. Comput. Appl. Math., 50 

(1994), 9-31. 

D. M. Monroe, Algorithm AS 83. Complex discrete fast Fourier transform, Appl. Statis¬ 
tics, 24 (1975), 153-160. 

_, Algorithm AS 97. Real discrete fast Fourier transform, Appl. Statistics, 25 (1976), 

166-172. 

_and J. L. Branch, Algorithm AS 117. The Chirp discrete fast Fourier transform 

of general length, Appl. Statistics, 26 (1977), 351-361. 

B. P. Moors, Valeur Approximative dune Integrale Definie, Gauthier-Villars, Paris, 1905. 

C. R. Morrow, A Study of Some Numerical Quadrature and Cubature Processes, Ph.D. 

Thesis, Belfast, 1977. 

G. Muhlbach, Neville-Atkin algorithms for interpolating by functions of Chebyshev-systems 
in the sense of Newton and in a generalized sense of Hermite, in Theory of Approxi¬ 
mations with Applications (A. G. Law and B. N. Sahney, eds.), Academic Press, New 
York, 1976, pp. 200-212. 

A. Murli and V. Patruno, Un metode per Tinversione numerica della transformata de 
Laplace, Calcolo, 15 (1978). 

_and M. Rizzardi, Algorithm 682: Talbot’s method for the Laplace inversion prob¬ 
lem, ACM Trans. Math. Software, 16 (1990), 158-168. 

M. J. P. Musgrave and J. Tasi, Shock waves in diatomic chains. I. Linear analysis, J. 
Mech. Phys. Solids, 24 (1976), 19-42. 

N. I. Mushkhelishvili, Singular Integral Equations, Dover Publications, New York, 1992. 

G. Myerson, On ignoring singularity, SIAM J. Numer. Anal, 28 (1991), 1803-1807. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


573 


NAG Ltd., NAG Fortran Library Manual — Mark 17, Numerical Analysis Group, NAG 
Central Office, Oxford, 1996. 

M. T. Nair, A unified approach for regularized approximation methods for Fredholm inte¬ 
gral equations of the first kind, Numer. Functional Anal. Optim., 15 (1994), 381. 

I. P. Natanson, Constructive Function Theory, I, Ungar, New York, 1964. 

NBS Handbook, Handbook of Mathematical Functions, National Bureau of Standards, 
Applied Math. Series, No. 55, U.S. Govt. Printing Office, Washington, DC, 1964. 

P. Nevai, Mean convergence of Lagrange interpolation. Ill, Trans. Amer. Math. Soc., 282 
(1984), 669-698. 

Y. Nievergelt, Wavelets Made Easy, Birkhauser, Boston, 1999. 

B. Noble, The Numerical Solution of Integral Equations, in The State of the Art in Nu¬ 
merical Analysis (D. A. H. Jacobs, ed.), Academic Press, New York, 1977. 

N. A. Noda and T. Matsuo, Numerical solutions of singular integral equations having 

Cauchy-type singular kernel by means of expansion method, Inti. J. of Fracture, 63 
(1993), 229. 

H. V. Norden, Numerical inversion of the Laplace transform, Acta Acad. Aboensis Matem. 
et Physica , 22 (1961), 1-30. 

S. E. Notaris, An overview of results on the existence or nonexistence and the error 

term of Gauss-Kronrod quadrature formulae, in Approximation and Computation: A 
Festschrift in Honor of Walter Gautschi (R. V. M. Zahar, eds.), Vol. 119 of Internatal 
Ser. Numer. Math., Birkhauser, Boston, 1994, pp. 485-496. 

H. H. Nutall, Some windows with very good sidelobe behavior, IEEE Trans, of Acoustics 
Speech and Signal Processing (ASSP), 29 (1980), 84. 

E. J. Nystrom, Uber die praktische Auflosung von Integralgleichungen mit Anwerdungen 

auf Randwertaufgaben, Acta Math., 54 (1930), 185-204. 

F. Oberhettinger and and L. Badu, Tables of Laplace Transforms, Springer-Verlag, 
Berlin, New York, 1973. 

W. C. Obi, Error analysis of a Laplace transform inversion procedure, SIAM J. Numer. 
Anal., 27 (1990), 457-469. 

H. O’Hara and F. H. Smith, Error estimation in the Clenshaw-Curtis quadrature formu¬ 
lae, Computer J., 11 (1968), 213-219. 

_and F. J. Smith, The evaluation of definite integrals by interval subdivision, Com¬ 
puter J., 12 (1969), 179-182. 

M. A. O’Neill, Faster Than Fast Fourier, BYTE, (April 1988), 293-300. 

T. Ooura and M. Mori, A double exponential formula for oscillatory functions over the 

half infinite interval, J. Comput. Appl. Math., 38 (1991), 353-360. 

D. F. Paget, Generalized Product Integration, Ph. D. Thesis, University of Tasmania, 
Hobart, 1976. 

_, The numerical evaluation of Hadamard finite-part integrals, Numer. Math., 36 

(1981), 447-453. 

A. Palamara-Orsi, Two algorithms for the construction of product formulas, Computing, 
49 (1993), 367-372. 

R. E. A. C. Paley, A remarkable system of orthogonal functions, Proc. London Math. 
Soc., 34 (1932), 241-279. 

_and A. Zygmund, On some series of functions, Proc. Cambridge Phil. Soc., 34 

(1930), 337-357, 458-474,(1932), 190-205. 

G. Pantis, The evaluation of integrals with oscillatory integrands, J. Comp. Phys., 17 
(1975), 229-233. 

Y. C. Pao, Engineering Analysis, CRC Press, Boca Raton, FL, 1999. 

A. Papoulis, A new method of inversion of the Laplace transform, Quart. Appl. Math., 
14 (1956), 405-414. 

_, Signal Analysis, 4th ed., McGraw-Hill, New York, 1988. 

T. N. L. Patterson, The optimal addition of points to quadrature formulae, Math. Comp., 


2005 by Chapman & Hall/CRC Press 



574 


BIBLIOGRAPHY 


22 (1968), 847-856. 

_, On some Gauss and Lobatto based integration formulae, Math. Comp., 22 (1968), 

877-881. 

_, Integration formulas using derivatives , Math. Comp., 23 (1969), 411-412. 

_, Algorithm 468. Algorithm for automatic numerical integration over a finite inter¬ 
val, Comm ACM, 16 (1973), 694-699. 

_, On high precision methods for the evaluation of Fourier integrals with finite and 

infinite limits , Numer. Math., 27 (1976), 41-52. 

_, On the construction of a practical Ermakov-Zolotukhin multiple integration , in 

Numerical Integration — Recent Developments, Software and Applications (P. Keast 
and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 269-290. 

_, An algorithm for generating interpolatory quadrature rules of the highest degree 

of precision with preassigned nodes for general weight function, ACM Trans. Math. 
Software, 15 (1989a), 123-136. 

_, Algorithm 672: Generation of interpolatory quadrature rules of the highest degree 

of precision with preassigned nodes for general weight functions, ACM Trans. Math. 
Software, 15 (1989b), 137-143. 

F. Peherstofer, Characterization of positive quadrature formulae, SIAM J. Math. Anal., 

12 (1981), 935-942. 

_, On the remainder of Gaussian quadrature formulas for Bernstein-Szego weight 

functions, Math. Comp., 60 (1993), 317-325. 

I. G. Petrovskii, Lectures on the Theory of Integral Equations, Grylock Press, New York, 

1957. 

D. L. Phillips, A technique for the numerical solution of certain integral equations of the 
first kind, J. Assoc. Computing Machinery, 9 (1962), 84-97. 

G. M. Phillip and P. J. Taylor, Theory and Applications of Numerical Analysis, 2nd 
ed., Academic Press, London, 1996. 

J. L. Phillips, Collocation as a projection method for solving integral and other operator 

equations, Fh.D. Thesis, Purdue University, IN, 1969. 

E. Picard, Sur un example simple d’une equation singuliere de Fredholm ou la nature 

analytique de la solution depend au second solution, Ann. Sci. Ecole Norm. Sup. (3), 
28 (1911), 313-324. 

R. Piessens, Numerical inversion of the Laplace transform, IEEE Trans. Automatic Con¬ 
trol, AC-14 (1969a), 299-301. 

_, Gaussian quadrature formulas for the numerical integration of Bromwich’s integral 

and the inversion of the Laplace transform (1969b), Inst. Appl. Math., University of 
Leuven. 

_, New quadrature formulas for the numerical inversion of the Laplace transform, 

BIT, 9 (1969c), 351-361. 

_, Gaussian quadrature formulas for the numerical integration of Bromwich ’s integral 

and the inversion of the Laplace transform, J. Engg. Math., 5 (1971a), 1-9. 

_, Calculation of Fourier coefficients of a function given at a set of arbitrary points, 

Electron. Lett., 7 (1971b), 681-682. 

_, Improved method for calculation of Fourier coefficients of a function given at a 

set of arbitrary points, Electron. Lett., 8 (1972a), 250-251. 

_, A new numerical method for the inversion of the Laplace transform, J. Inst. Maths. 

Appl., 10 (1972b), 185-192. 

_, Algorithm 453. Gaussian quadrature formulas for Bromwich’s integral, Comm. 

ACM, 16 (1973a), 468-487. 

_, An algorithm for automatik intregration, Angew. Informatik, 15 (1973b), 399-401. 

_, A quadrature routine with round-off error guard, Rep. TW 17 (1974), Appl. Math. 

and Prog. Div., Kath. Univ. Leuven. 

_, An automatic routine for the integration of oscillating functions, Rep. TW 30 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


575 


(1975), Appl. Math, and Prog. Div., Kath. Univ. Leuven. 

_, A bibliography on numerical inversion of Laplace transform and applications, J. 

Comput. Appl. Math., 1 (1975), 115-128. 

_, A bibliography on numerical inversion of Laplace transform and applications: A 

supplement , J. Comput. Appl. Math., 2 (1976), 225-228. 

_, Automatic computation of Bessel function integrals , Comp. Phys. Comm., 25 

(1982a), 289-295. 

_, Algorithm 113: Inversion of the Laplace transform, Algorithm Supplement , Com¬ 
puter J., 25 (1982b), 278-282. 

_, An algorithm for a special case of a generalization of the Richardson extrapolation 

process, Numer. Math., 38 (1982), 299-307. 

_, Modified Clenshaw-Curtis integration and applications to numerical computation 

of integral transforms, in Numerical Integration — Recent Developments, Software and 
Applications (P. Keast and G. Fairweather, eds.), D. Reidel, Dordrecht, the Nether¬ 
lands, 1987, pp. 35-51. 

_, On rates of acceleration of extrapolation methods for oscillatory infinite integrals, 

BIT, 30 (1990), 347-357. 

_and M. Branders, Numerical inversion of the Laplace transform using generalized 

Laguerre polynomials, Proc. IEEE, 118 (1971), 1517-1522. 

_and M. Branders, The evaluation and application of some modified moments, BIT, 

13 (1973), 443-450. 

_and M. Branders, A note on the optimal addition of abscissas to quadrature for¬ 
mulas of Gauss and Lobatto type, Math. Comp., 28 (1974), 135-140; 344-347. 

_and M. Branders, Computation of oscillatory integrals, J. Comput. Appl. Math., 

1 (1975), 153-164. 

_and M. Branders, Algorithm 002. Computation of oscillating integrals, J. Comput. 

Appl. Math., 1 (1975), 153-164. 

_and M. Branders, Tables of Gaussian Quadrature Formulas, Academic Press, Leu¬ 
ven, 1975. 

_and M. Branders, Computation of oscillating integrals, J. Comp. Appl. Math., 1 

(1975), 153-. 

_and M. Branders, Modified Clenshaw-Curtis method for the computation of Bessel 

function integrals, BIT, 23 (1983), 370-381. 

_and M. Branders, Computation of Fourier and Laplace transforms of singular 

functions using modified moments, Comp. Math. Appls., 12B (1986), 1241-1248. 

_, E. de Doncker-Kapenga, C. W. Uberhuber, and D. K. Kahaner, QUADPACK 

— A Subroutine Package for Automatic Integration, Springer-Verlag, Berlin, 1983. 

_, E. de Doncker-Kapanga, C. W. Uberhuber, and M. D. K. Kahaner, QUAD- 

PACK, A Quadrature Subroutine Package, Series in Computational Math.,, vol. 1, 
Springer-Verlag, Berlin, 1983. 

_and A. Haegemans, Numerical evaluation of Fourier transform integrals, Electron 

Lett., 9 (1973), 108-109. 

_and A. Haegemans, Algorithm 22. Automatic integration of highly oscillatory func¬ 
tions, Computing, 13 (1974), 183-193. 

_and R. Huysmans, Algorithm 619: Automatic numerical inversion of Laplace trans¬ 
form, ACM Trans. Math. Software, 10 (1984), ?. 

_, I. Mertens and M. Branders, Automatic integration of functions having alge¬ 
braic end point singularities, Angewandte Informatik, 2 (1974), 65-68. 

_and F. Poleunis, A numerical method for the integration of oscillatory functions, 

BIT, 11 (1971), 317-327. 

_, van Roy-Branders and I. Mertens, Automatic evaluation of Cauchy principal 

value integrals, Angewandte Informatik, 18 (1976), 31-35. 

_and P. Verbaeten, Numerical solution of the Abel integral equation, Nordisk Tid- 


2005 by Chapman & Hall/CRC Press 



576 


BIBLIOGRAPHY 


skr. Informationsbehandling (BIT), 13 (1973), 451-457. 

J. C. Piquette, A method for symbolic evaluation of infinite integrals containing special 
functions or their products, J. Symbolic Comput., 11 (1991), 231-249. 

E. Poincare, Remarque diverses sur Vequation de Fredholm, Acta Math., 33 (1910), 57-89. 
H. Pollard, Note on the inversion of the Laplace integral, Dume Math. J., 6 (1940), 
420-424. 

G. Polya, Uber Konvergenz von Quadraturverfahren, Math. Zeit., 37 (1933), 264-286. 

A. D. Polyanin and A. V. Manzhirov, Handbook of Integral Equations, CRC Press, Boca 
Raton, FL, 1998. 

D. Porter and D. S. G. Stirling, Integral Equations, Cambridge University Press, Cam¬ 

bridge, 1993. 

E. L. Post, Generalized Differentiation, Trans. Amer. Math. Soc., 32 (1930), 723-793. 

M. J. D. Powell, On best L 2 spline approximations, in Numerische Mathematik, Diffen- 

tialgleichungen, Approximationstheorie, Birkhauser, Basel, 1968, pp. 317-336. 

_, Approximation Theory and Methods, Cambridge Univ. Press, Cambridge, 1981. 

W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical 
Recipes, Cambridge University Press, London, 1986. 

_, Numerical Recipes in Fortran, Cambridge University Press, New York, 1992. 

J. F. Price, Discussion of quadrature formulas for use on digital computers, Rep. Dl-82- 
0052, Boeing Sci. Res. Labs. (1960). 

P. Puri, Impulsive motion of a flat plate in a Rivlin-Ericksen fluid, Rheol. Acta , 23 
(1984), 451-453. 

_and P. K. Kulshrestha, Rotating flow of non-Newtonian fluids, Applicable Anal., 

4 (1974), 131-140. 

_and P. K. Kulshrestha, Unsteady hydromagnetic boundary layer in a rotating 

medium, Trans. ASME, J. Appl. Mech., 98 (1976), 205-208. 

_and P. K. Kythe, Some inverse Laplace transforms of exponential form, ZAMP, 

39 (1988), 150-156. 

P. Rabinowitz, Abscisses and weights for Lobatto quadrature of high order, Math. Comp., 
14 (1960), 47-52. 

_, Rates of convergence of Gauss, Lobatto, and Radau integration rules for singular 

integrands, Math. Comp., 41 (1983), 63-78. 

_, Gauss-Kronrod integration rules for Cauchy principal value integrals, Math. Comp., 

41 (1983), 63-78. 

_, The convergence of noninterpolatory product integration rules, BIT, 26 (1986), 

131-134. 

_, Numerical integration in the presence of an interior singularity, J. Comp. Appl. 

Math., 17 (1987), 31-41. 

_, Convergence results for piecewise linear quadratures for Cauchy principal value 

integrals, Math. Comp., 51 (1988), 741-747. 

_, On an interpolatory product rule for evaluating Cauchy principal value integrals, 

BIT, 29 (1989), 347-355. 

_, Generalized noninterpolatory rules for Cauchy principal value integrals, Math. 

Comp., 54 (1990), 271-279. 

_, Numerical evaluation of Cauchy principal value integrals with singular integrands, 

Math. Comp., 55 (1990), 265-270. 

_, Froduct integration of singular integrands using Hermite-Fejer interpolation, BIT, 

31 (1991), 321-327. 

_, Uniform convergence results for Cauchy principal value integrals, Math. Comp., 

56 (1991), 731-740. 

_, Application of approximating splines for the solution of Cauchy singular integral 

equations, Trans. Appl. Numer. Math., 15 (1994), 285. 

_and N. Richter, Ferfectly symmetric two-dimensional integration formulas with 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


577 


minimal number of points, Math. Comp., 23 (1969), 765-799. 

_, The convergence of interpolatory product integration rules , BIT, 26 (1986), 131- 

134. 

_, Numerical integration in the presence of an interior singularity, J. Comp. Appl. 

Math., 17 (1987), 31-41. 

_, The convergence of noninterpolatory product integration rules, in Numerical In¬ 
tegration — Recent Developments, Software and Applications (P. Keast and G. Fair- 
weather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 1-16. 

_, Numerical integration based on approximating splines, J. Comput. Appl. Math., 

33 (1990), 73-83. 

_, Application of approximating splines for the solution of Cauchy singular integral 

equations, Trans. Appl. Numer. Math., 15 (1994), 285. 

_, J. Kautsky, S. Elhay, and J. C. Butcher, On sequences of imbedded integration 

rules, in Numerical Integration — Recent Developments, Software and Applications (P. 
Keast and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 1987, pp. 113- 
139. 

_and D. S. Lubinsky, Noninterpolating integration rules for Cauchy principal value 

integrals, Math. Comp., 53 (1989), 279-295. 

_and E. Santi, On the uniform convergence of Cauchy principal values of quasi- 

interpolating splines, BIT, 35 (1995), 277-290. 

_and I. H. Sloan, Product integration in the presence of a singularity, SIAM J. 

Numer. Anal., 21 (1984), 149-166. 

_and W. E. Smith, Interpolatory product integration in the presence of singularities: 

L 2 theory, J. Comput. Appl. Math., 39 (1992), 79-87. 

_and W. E. Smith, Interpolatory product integration in the presence of singularities: 

L p theory, in Numerical Integration — Recent Developments, Software and Applica¬ 
tions (T. O. Espelid and A. Genz, eds.), Kluwer, Dordrecht, 1992, pp. 93-109. 

R. Radau, Etude sur les formules d’approximation qui servent a calculer la valeur numerique 
d’une integrale definite, J. Math. Pures Appl.,(3), 6 (1880), 283-336. 

E. D. Raineville, Special Functions, Macmillan & Co., New York, 1960. 

A. Ralston, A family of quadratures which achieve high accuracy in composite rules, J. 
ACM, 6 (1959), 384-394. 

_and P. Rabinowitz, A First Course in Numerical Analysis, 2nd ed., McGraw-Hill, 

New York, 1978. 

L. Reischel, Parallel iterative methods for the solution of Fredholm integral equations of 

the second kind, in Hypercube Multiprocessors (M. T. Heath, ed.), SIAM, Philadelphia, 
PA, 1987, pp. 520-529. 

_, Fast solution methods for Fredholm integral equations of the second kind, Numer. 

Math., 57 (1989), 719-736. 

J. R. Rice (ed.), Mathematical Software, Academic Press, New York, 1971. 

_, A metaalgorithm for adaptive quadrature, J. ACM, 22 (1975), 61-82. 

_, Numerical Methods, Software, and Analysis, McGraw-Hill, New York, 1983. 

J. F. Ritt, Integration in Finite Terms, Columbia Univ. Press, New York, 1948. 

T. J. Rivlin, An Introduction to the Approximation of Functions, Dover, New York, 1981. 
_, The Chebyshev Polynomials, 2nd ed., Wiley, New York, 1990. 

M. Rizzardi, A modification of Talbot’s method for the simultaneous approximation of 
several values of the inverse Laplace transform, ACM Trans. Math. Software, 21 (1995), 
347-371. 

F. J. Rizzo and D. J. Shippy, A method of solution for certain problems of transient heat 

conduction, AIAA J., 8 (1970), 2004-2009. 

G. E. Roberts and H. Kaufman, Table of Laplace Transform, W. B. Saunders Company, 

Philadelphia and London, 1966. 

I. G. Robinson, Adaptive Gaussian integration, Austral. Comput. J., 3 (1971), 126-129. 


2005 by Chapman & Hall/CRC Press 



578 


BIBLIOGRAPHY 


_and E. de Doncker, Algorithm 45. Automatic computation of improper integrals 

over a bounded or unbounded planar region, Computing, 25 (1981), 253-284. 

G. Rodriguez and S. Seatzu, On the numerical inversion of the Laplace transform in 
reproducing kernel Hilbert spaces , IMA J. Numer. Anal., 13 (1993), 463-475. 

C. J. Roothart and H. Fiolet, Quadrature procedures , Report MR 137/72 (1972), Math- 
ematisch Centrum, Amsterdam. 

M. Rosenlicht, Integration infinite terms , Amer. Math. Monthly, 79 (1972), 963-972. 

H. Rutishauser, Ausdehnung des Romberg’schen Prinzips , Num. Math., 5 (1963), 48-54. 
_, On a modification of the QD-algorithm with Graeffe-type convergence, in Proc. 

IFIP Congress 62, North-Holland, Amsterdam, 1993. 

A. Saenger, On a numerical quadrature of Fourier transform , J. Math. Anal. Appl., 8 
(1964), 1-3. 

S. Saitoh, One approach to some general integral transforms and its applications, Integral 

Eqs. and Special Functions, 3 (1995), 49-84. 

H. E. Salzer, Orthogonal polynomials arising in the numerical evaluation of inverse 
Laplace transform, Mathematical Tables and Other Aids to Computation, 9 (1955), 
163-177. 

_, Equally weighted quadrature formulas over semi-infinite and infinite intervals, J. 

Math. Phys., 34 (1955), 54-63. 

_, Tables for the numerical calculation of inverse Laplace transforms, J. Math. Phys., 

37 (1958), 89-108. 

_, Additional formulas and tables for orthogonal polynomials originating from inver¬ 
sion integrals, J. Math. Phys., 40 (1961), 72-86. 

G. Sansone, Functional Analysis, McGraw-Hill, New York, 1973. 

J. Saranen and I. H. Sloan, Quadrature methods for logarithmic-kernel integral equations 
on closed curves, IMA J. Numer. Anal., 12 (1992), 167. 

A. Sard, Integral representations of remainders, Duke Math. J., 15 (1948), 333-345. 

_, Best approximate integration formulas; best approximation formulas, Amer. J. 

Math., 71 (1949), 80-91. 

_and L. F. Meyers, Best approximate integration formulas, J. Math. Phys., 29 

(1950), 118-123. 

_, Linear Approximation, American Math. Soc., Providence, RI, 1963. 

R. A. Schapery, Approximate methods of transform inversion for viscoelastic stress anal¬ 
ysis, Proc. Fourth U.S. National Congr. Appl. Mech. (1961), 1075-1085. 

_, Approximate methods of transform inversion for viscoelastic stress analysis, Proc. 

4th U.S. Nat. Congr. Appl. Mech., ASME, 2 (1962), 1075-1085. 

F. Scheid, Theory and Problems of Numerical Analysis, Schaum’s Outline Series, McGraw- 

Hill, New York, 1968. 

T. Schira, The remainder term for analytic functions of Gauss-Lobatto quadratures, J. 
Comp. Appl. Math., 76 (1996), 171-193. 

_, The remainder term for analytic functions of symmetric Gaussian quadratures, 

Math. Comp., 66 (1997), 297-310. 

G. Schmeisser AND H. Schirmeier, Praktische Mathematik, Walter de Gruyter, Berlin, 
1976. 

L. A. Schmittroth, Numerical inversion of Laplace transforms, Comm. ACM, 3 (1960), 
171-173. 

C. Schneider, Regularity of the solution to a class of weakly singular Fredholm integral 
equations of the second kind, Integral Eqns. Operator Theory, 2 (1979), 62-68. 

_, Product integration for weakly singular integral equations, Math. Comput., 36 

(1981a), 207-213. 

_, Produktintegration zur Losung schwachsingularen Integralgleichungen, ZAMM, 8 

(1981b), T317-319. 

L. A. Schmittroth, Numerical inversion of Laplace transforms, Comm. ACM, 3 (1960), 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


579 


171-173. 

C. Schwartz, Numerical evaluation of analytic functions, J. Comp. Phys., 4 (1969), 19-29. 

T. S. Shao, T. C. Chen, and R. M. Frank, Tables of zeros and Gaussian weights of cer¬ 
tain associated Laguerre polynomials and the related generalized Hermite polynomials, 
Math. Comp., 18 (1964), 598-616. 

L. F. Shampine and R. C. Allen, Jr., Numerical Computing: An Introduction, W. B. 
Saunders, Philadelphia, Pa, 1973. 

D. Shanks, Non-linear transformations of divergent and slowly convergent sequences, J. 
Math. Phys., 34 (1955), 1-42. 

C. E. Shannon, Communications in the presence of noise, Proc. Inst. Radio Eng., 37 
(1949), 10-21. 

B. G. Sherlock and D. M. Monro, Algorithm 749: Fast discrete cosine transform, ACM 
Trans. Math. Software, 21 (1995), 372-378. 

J. Shohat, Laguerre polynomials and the Laplace transform, Duke Math. J., 6 (1940), 
615-626. 

A. Sidi, Some properties of a generalization of the Richardson extrapolation process, J. 
Inst. Math. Appl., 24 (1979), 327-346. 

_, Extrapolation methods for oscillatory infinite integrals, J. Inst. Math. Appl., 26 

(1980), 1-20. 

_, The numerical evaluation of very oscillatory infinite integrals by extrapolation, 

Math. Comp., 38 (1982), 517-529. 

_, An algorithm for the special case of a generalization of the Richardson extrapola¬ 
tion process, Numer. Math., 38 (1982), 299-307. 

_, The numerical evaluation of very oscillatory infinite integrals by extrapolation, 

Math. Comp., 38 (1982), 517-529. 

_, Extrapolation methods for divergent oscillatory infinite integrals that are defined 

in the sense of summability, J. Comp. Appl. Math., 17 (1987), 105-114. 

_, Generalizations of Richardson extrapolation with applications to numerical in¬ 
tegration, in Numerical Integration III— Proceedings of the Conference at the Mat. 
Inst., Oberwolfach, 1988 (H. BraBand G. Hammerlin, eds.), Birkhauser, Basel, 1988, 
pp. 237-250. 

_, A user-friendly extrapolation method for infinite integrals, Math. Comp., 51 (1988), 

249-266. 

_, Comparison of some numerical quadrature formulas for weakly singular periodic 

Fredholm integral equations, Computing: Archiv fur Informatik und Numerik., 43 
(1989), 159. 

_, On rates of acceleration of extrapolation methods for oscillatory infinite integrals, 

BIT, 30 (1990), 347-357. 

_, Computation of oscillatory infinite integrals by extrapolation methods, in Numeri¬ 
cal Integration — Recent Developments, Software and Applications (T. O. Espelid and 
A. Genz, eds.), Kluwer, Dordrecht, 1992, pp. 349-351. 

_, A new variable transformation for numerical integration, in Numerical Integration 

III — Proceedings of the Conference at the Mat. Inst., Oberwolfach, 1992 (H. BraBand 
G. Hammerlin, eds.), Birkhauser, Basel, 1993, pp. 359-373. 

P. Silvestor, Symmetric quadrature formulae for simplexes, Math. Comput., 24 (1970), 
95-100. 

R. C. Singleton, On computing the fast Fourier transform, Comm. ACM, 10 (1967), 
647-654. 

N. S. Skoblya, Tables for the Numerical Inversion of the Laplace Transforms, Izdat. Akad. 
Nauk BSSR, Minsk, 1964. (Russian) 

I. H. Sloan, Iterated Galerkin method for eigenvalue problems, SIAM J. Numer. Anal., 13 
(1976), 753-760. 

_, On the numerical evaluation of singular integrals, BIT, 18 (1978), 91-102. 


2005 by Chapman & Hall/CRC Press 



580 


BIBLIOGRAPHY 


_, The numerical solution of Fredholm equations of the second kind by polynomial 

interpolation, Technical Note BN 905 (1979), University of Maryland. 

_, On choosing the points in product integration, J. Phys. Phys., 21 (1980), 1032- 

1039. 

_, The numerical solution of Fredholm equations of the second kind , J. Integral Eq., 

2 (1980), 265-279. 

_, A review of numerical methods for Fredholm equations of the second kind , in The 

Application and Numerical Solution of Integral Equations (R. S. Anderssen, F. R. de 
Hoog and M. A. Lukas, eds.), Sijthoff and Noordhoff, Alphen aan den Rijn, 1980. 

_, B. Burn, and N. Datyner, A new approach to the numerical solution of integral 

equations , J. Comput. Phys., 18 (1975). 

_and B. Burn, Collocation with polynomials for integral equations of the second 

kind: A new approach to the theory , J. Integral Eq., 1 (1979), 77-94. 

_and W. E. Smith, Product-integration with the Clenshaw-Curtis and related points. 

Convergence properties , Numer. Math., 30 (1978), 415-428. 

_and W. E. Smith, Product-integration with the Clenshaw-Curtis and related points. 

Implementation and error estimates , Numer. Math., 34 (1980), 387-401. 

_and W. E. Smith, Properties of interpolatory product integration rules , SIAM J. 

Numer. Anal., 19 (1982), 427-442. 

B. T. Smith, J. M. Boyla, B. S. Garbow, Y. Ikebe, V. C. Klema, and C. B. Moler, 
Matrix Eigensystem Routines — EISPACK Guide , Lecture Notes in Computer Science 
#6, 2nd ed., Springer-Verlag, Berlin, 1976. 

F. J. Smith, Quadrature methods based on the Euler-Maclaurin formula and on the Clenshaw- 
Curtis method of integration, Numer. Math., 7 (1965), 406-411. 

W. E. Smith and I. H. Sloan, Product integration rules based on the zeros of Jacobi 
polynomials, SIAM J. Numer. Anal., 17 (1980), 1-13. 

_I. H. Sloan, and A. H. Opie, Product integration over infinite intervals.I. Rules 

based on the zeros of Hermite polynomials, Math. Comp., 40 (1983), 519-535. 

_and D. F. Paget, Optimal nodes for interpolatory product integration, SIAM J. 

Numer. Anal., 29 (1992), 586-600. 

I. N. Sneddon, Fourier Transform and Its Applications, Springer-Verlag, Berlin, 1978. 

A. Spence, Product integration for singular integrals and singular integral equations, in 
Numerische Integration (G. Hammerlin, eds.), ISNM 45, Birkhauser, Basel, 1979. 

M. R. Spiegel, Mathematical Handbook of Formulas and Tables, McGraw-Hill, New York, 
1968. 

W. Squire, Comment on numerical calculation of Fourier transform integrals, Electron. 
Lett. Math., 9 (1973), 291. 

_, Partition-extrapolation methods for numerical quadrature, Intern. J. Comput. 

Math., 5 (1975), 81-91. 

_, A quadrature method for finite intervals, Intern. J. Numer. Methods in Engg., 10 

(1976a), 708-712. 

_, Integration for Engineers and Scientists, Amer. Elsevier, New York, 1976b. 

_, A comment on quadrature in the presence of end-point singularities, Int. J. Comp. 

Math., 7 (1979), 239-241. 

_, Comparison of Gauss-Hermite and midpoint quadrature with application to the 

Voigt function, in Numerical Integration — Recent Developments, Software and Ap¬ 
plications (P. Keast and G. Fairweather, eds.), D. Reidel, Dordrecht, the Netherlands, 
1987, pp. 111-112. 

H. Stehfest, Algorithm 368: Numerical inversion of Laplace transform, Comm. ACM, 13 
(1970a), 47-49. 

_, Remark on Algorithm 368, Comm. ACM, 13 (1970b), 624. 

E. M. Stein and G. Weiss, Introduction to Fourier Analysis on Euclidean Spaces, Prince¬ 
ton Univ. Press, NJ, 1971. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


581 


T. J. Stieltjes, Quelques recherches sur la theorie des quadratures dites mecanique, Ann. 

Sci. Ecole Norm. Sup.,(3), 1 (1884), 409-426. 

M. R. Spiegel, Mathematical Handbook of Formulas and Tables , Schaum’s Outline Series, 
McGraw-Hill, New York, 1968. 

P. Stigall, R. E. Ziemer and L. Hudec, A performance study of 16-bit microcomputer- 
implemented FFT algorithms , IEEE Micro, (1982), 61. 

U. Storck, Verified calculation of the nodes and weights for Gaussian quadrature formulas, 

Interval Compu., 4 (1993), 114-124. 

J. O. Stromberg, A modified Franklin system and higher order spline systems on R n 
as unconditional basis for Hardy spaces , in Conference in Honor of A. Zygmund (W. 
Beckner, ed.), Vol. II, Wadsworth, 1981, pp. 475-493. 

A. H. Stroud, Approximate Calculation of Multiple Integrals , Prentice-Hall, Englewood 
Cliffs, NJ, 1971. 

_, Numerical Quadrature and Solution of Ordinary Differential Equations , Springer- 

Verlag, New York, 1974. 

_ and D. Secrest, Gaussian Quadrature Formulas , Prentice-Hall, Englewood Cliffs, 

NJ, 1966. 

_, Interactive numerical quadrature , in Numerical Integration — Recent Develop¬ 
ments, Software and Applications (P. Keast and G. Fairweather, eds.), D. Reidel, Dor¬ 
drecht, the Netherlands, 1987, pp. 291-306. 

F. Stummel and K. Hainer, Praktische Mathematik , 2nd. ed., Teubner, Stuttgart, 1982. 
M. Sugihara, Methods of numerical integration of oscillatory functions by the DE-formula 

with Richardson extrapolation , J. Comp. Appl. Math., 17 (1987a), 47-68. 

G. T. Symm, Integral equation methods in potential theory, II, Proc Royal Soc., Ser. A 275 

(1963), 33-46 (for part I, see M. A. Jawson). 

_, An integral equation method in conformal mapping, Numerische Math. 9 (1966), 

250-258. 

_, Problems in two-dimensional potential theory (Ch. 20). Potential problems in three 

dimensions (Ch. 24), in Numerical Solution of Integral Equations (L. M. Delves and J. 
Walsh, eds.), Clarendon Press, Oxford, 1974, pp. 267-274; 312-320. 

G. Szego, Orthogonal Polynomials, Colloquium Publications, # 23, Amer. Math. Soc., 
1939. 

H. Takahasi and M. Mori, Estimation of errors in the numerical quadrature of analytic 
functions, Applicable Anal., 1 (1971), 201-229. 

_and M. Mori, Quadrature formulas obtained by variable transformation, Numer. 

Math., 21 (1973), 206-219. 

A. Talbot, The accurate numerical inversion of Laplace transforms, J. Inst. Maths. Ap¬ 
plies., 23 (1979), 97-120. 

R. I. Tanner, An inversion formula for the Laplace integral, Duke Math. J., 6 (1940), 
1-26. 

C. Taswell and K. C. McGill, Algorithm 735: Wavelet transform algorithms for finite- 

duration discrete-time signals, ACM Trans. Math. Software, 20 (1994), 398-426. 

H. J. J. te Riele, A program for solving the first kind Fredholm integral equations by means 
of regularisation, Report NM-R8416, Dept, of Numerical Math., Amsterdam (1984). 

D. ter Haar, An easy approximate method of determining the spectrum of a viscoelastic 

material, J. Polymer Sci., 6 (1951), 247. 

The MathWorks, MATLAB, Version 6, The MathWorks, Natick, MA, 1984-2000. 

P. S. Theocaris and N. I. Ioakimidis, On the numerical solution of Cauchy type singular 
integral equations and the determination of stress intensity factors in case of complex 
singularities, ZAMM, 28 (1977), 1085-1098. 

A. N. Tikhonov, On the solution of ill-posed problems and the method of regularization, 
Soviet Math. Dokl., 4 (1963), 1035-1038. 

_and V. B. Glasko, An approximate solution of Fredholm integral equation of the 


2005 by Chapman & Hall/CRC Press 









582 


BIBLIOGRAPHY 


first kind, Zhurnal vychislitel’noy matematiki i matematicheskoy Fiziki, 4 (1964), 564- 
571 (Russian). 

S. Timoshenko and J. N. Goodier, Mathematical Theory of Elasticity, McGraw-Hill, New 
York, 1951. 

H. Toda and H. Ono, Notes on effective usage of double exponential formulas for numer¬ 
ical integration , in Numerical Integration and Related Topics (M. Mori, eds.), RIMS 
Kokyuroka 401, Kyoto Univ., 1980, pp. 21-47. 

J. N. Tokis, Unsteady magnetohydrodynamic free-convection flows in a rotating fluid, As- 
trophys. Space Sc., 119 (1996), 305-313. 

H.-J. Topler and W. Volk, Die numerische Behandlung von Integralgleichungen zweiten 
Art mittels Splinefunktionen, in Numerical Treatment of Integral Equations (J. Albrecht 
and L. Collatz, eds.), ISNM 53, Birkhauser, Basel, 1980, pp. 228-243. 

L. N. Trefethen (ed.), Numerical Conformal Mapping, North-Holland, Amsterdam, 1986. 

F. G. Tricomi, Integral Equations, Wiley Interscience, New York, 1957. 

A. N. Tikhonov, On the solution of ill-posed problems and the method of regularization, 
Soviet Math. Dokl., 4 (1963), 1035-1038. 

_and V. B. Glasko, An approximate solution of Fredholm integral equation of the 

first kind, Zhurnal vychislitel’noy matematiki i matematicheskoy Fiziki, 4 (1964), 564- 
571 (Russian). 

P. L. Tschebyscheff, Sur les quadratures, J. Math. Pures Appl., 19 (1874), 19-34. 

S. Twomey, On the numerical solution of Fredholm integral equations of the first kind 

by the inversion of the linear system produced by quadrature, J. Assoc. Computing 
Machinery, 10 (1963), 97-101. 

_, The application of numerical filtering to the solution of integral equations encoun¬ 
tered in indirect sensing measurements, J. Franklin Inst., 279 (1975), 95-109. 

D. Y. Tzou, Macro to Microscale Heat Transfer: The Lagging Behaviour, Taylor and 
Francis, Washington, 1997. 

_, M. N. Ozisik, and R. J. Chiffelle, The lattice temperature in the microscopic 

two-step model, J. Heat Transfer, Trans. ASME, 116 (1994), 1034-1038. 

_and Y. S. Zhang, An analytical study of the fast-transient process in small scales, 

Int. J. Eng. Sci., 33 (1995), 1449-1463. 

J. L. Ullman, A class of weight functions that admit Tschebyscheff quadrature, Michigan 
Math. J., 13 (1966), 417-423. 

G. M. Vainikko and A. Pedas, The properties of solutions of weakly singular integral 
equations, J. Aust. Math. Soc., Ser. B, 22 (1981), 419-430. 

_and P. Ubas, A piecewise polynomial approximation to the solution of an integral 

equation with weakly singular kernel, J. Aust. Math. Soc., Ser. B, 22 (1981), 431-438. 

J. M. Varah, Pitfalls in the numerical solution of linear ill-posed problems, SIAM J. Sci. 
Statist. Comput. 4 (1983), 164-176. 

N. P. Vekua, Systems of Singular Integral Equations, P. Noordhoff, The Netherlands, 1967. 

P. Vertesi, Remarks on convergence of Gaussian quadrature for singular integrals, Acta 
Math. Hung., 53 (1989), 399-405. 

T. von Petersdorff, C. Schwab, and R. Schneider, Multiwavelets for second kind 
integral equations, SIAM J. Numer. Anal., 34 (1997), 2212. 

G. Wahba, Practical approximate solutions of linear operator equations when the data are 
noisy, SIAM J. Appl. Math. 14 (1977), 651-667. 

G. C. Wallick, Remark on algorithm 351. Modified Romberg quadrature, ZAMM, 53 
(1973), 1-8. 

J. S. Walker, Fast Fourier Transforms, CRC Press, Boca Raton, FL, 1991. 

G. G. Walter, Wavelets and Other Orthogonal Systems with Applications, CRC Press, 
Boca Raton, FL, 1994. 

_, Pointwise convergence for wavelet expansions, J. Approx. Theory, 80 (1995), 108- 

118. 


2005 by Chapman & Hall/CRC Press 



BIBLIOGRAPHY 


583 


W. T. Weeks, Numerical inversion of Laplace transforms, J. ACM, 13 (1966), 419-426. 

J. A. C. Weideman, Algorithms for parameter selection in the Weeks method for inverting 
Laplace transforms, SIAM J. Sci. Comput., 21 (1999), 111-128. 

B. Wendroff, Theoretical Numerical Analysis, Academic Press, New York, 1966. 

H. Werner and D. Zwick, Algorithms for numerical integration with regular splines, 
Report No. 27 (1977), Rechenzentrum der Universitat Mrister. 

A. D. Wheelon, Tables of Summable Series and Integrals Involving Bessel Functions, 
Holden-Day, San Francisco, 1968. 

V. Wickerhauser, Adapted Wavelet Analysis from Theory to Software, AK Peters, Boston, 
1994. 

D. V. Widder, The inversion of the Laplace transform and the related moment problem, 
Trans. Amer. Math. Soc., 36 (1934), 107-200. 

_, An application of Laguerre polynomials, Duke Math. J., 1 (1935), 126-136. 

H. S. Wilf, The possibility of Tschebyscheff quadrature on infinite intervals, Proc. Nat. 
Acad. Sci., 47 (1961), 209-213. 

_, Exactness conditions in numerical quadrature, Numer. Math., 6 (1964), 315-319. 

R. E. Williamson, R. H. Crowell, and H. F. Trotter, Calculus of Vector Functions, 

Prentice-Hall, Englewood Cliifs, NJ, 1962, pp. 316. 

M. W. Wilson, A general algorithm for nonnegative quadrature formulas, Math. Comput., 
23 (1969), 253-258. 

J. Wimp, Computation with Recurrence Relations, Pitman Press, 1984. 

G. M. Wing, A Primer on Integral Equations of the First Kind, SIAM, Philadelphia, 1991. 

O. Wing, An efficient method of numerical inversion of Laplace transform, Computing, 2 

(1967), 153-166. 

P. Wojtaszczyk, The Franklin system is an unconditional basis in H 1 , Archiv fur Mat., 

20 (1982), 293-300. 

K. B. Wolf, Integral Transforms in Science and Engineering, Plenum Press, New York, 
1979. 

S. Wolfram, Mathematica, 2nd ed., Addison-Wesley, New York, 1991. 

_, The Mathematica Book, 3rd ed., Wolfram Media, Champaigne, IL, and Cambridge 

University Press, Cambridge, UK, 1996. 

P. Wynn, On a device for computing the e m (S n ) transformation, Math. Comp., 10 (1956), 
91-96. 

Y. Xu, Common Zeros of Polynomials in Several Variables and Higher Dimension Quad¬ 
rature, Pitman Series, Longman Scientific And Tech., 1994. 

Y. Yan, A fast numerical solution for a second kind integral equations with a logarithmic 
kernel, SIAM J. Numer. Math., 31 (1994), 477-498. 

A. Young, Approximate product-integration, Proc. Roy. Soc. London, Ser. A, 224 (1954a), 
552-561. 

_, The application of approximate product-integration to the numerical solution of 

integral equations, Proc. Roy. Soc. London, Ser. A, 224 (1954b), 561-573. 

S. Wolfram, The Mathematica Book, 4th Ed., Wolfram Media/Cambridge University 
Press, New York, 1999. 

A. Zygmund, Trigonometric Series, Cambridge Univ. Press, New York, 1957. 


2005 by Chapman & Hall/CRC Press 



